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CHAPTER  I 
INTRODUCTION 


1.1  Preliminaries 


Let  ...  be  a sequence  of  random  variables  (r.v.'s)  on  a 

probability  space  (J2,F,P),  and  let 


(1.1.1) 


.(n)  , 


. . . sc 


(n) 


’n 


be  the  corresponding  series  of  ascending  order  statistics  for  Cj , . • • , 

Cj^  . A sequence  of  integers  satisfying  1 < 1^  < n for  each 

n > 1 is  called  a rank  sequence,  and  the  variable  C^^  , the  k^-th 

smallest  of  Cj , • • • , we  say  is  of  rank  k^  among  Cj>  •••  • 

The  ratio  ~ is  called  the  relative  rank  of  the  term  cf^^  • 
n ^k 

n 

We  consider  the  asyn^totic  distributions  as  n -*■  “ of  sequences 

of  variables  • The  basis  of  our  investigation  is  the 

n 

theory  of  such  asymptotic  distributions  when  the  C^  3re  independent 
and  identically  distributed  (i.i.d.),  which  is  extensively  developed 
for  each  of  the  following  cases: 


(i)  kj^  equals  a fixed  integer  k > 1 for  each  n > k.  In  this 

case  we  call  a sequence  of  fixed  rank  or  extreme  order 

^n 

statistics. 


(ii)  K 


but  — 0 as  n In  this  case  Ci^^^ 


sequence  of  intermediate  order  statistics  and  k^^  an 


is  called  a 


2 


intermediate  rank  sequence, 
k 

(iii)  kj^  “ and  converges  to  a limiting  relative  rank  A, 

0 < A < 1.  Here  we  call  a sequence  of  central  order 

n 

statistics  and  k^  a central  rank  sequence. 


IVe  refer  to  (i)  as  the  case  of  fi.xed  ranks  :ind  to  (ii)  and  (iii) 
collectively  as  the  case  of  increasing  ranks,  although  for  the  latter 
Vve  do  not  in  general  require  that  k^^  increase  monotonically. 

Of  course  the  arrangement  (1.1.1)  in  ascending  order  is  merely 
conventional,  and  we  may  just  as  well  consider  the  series 


(1.1.2) 


(n)  > > (n) 

1*=  • • • n - 


of  descending  order  statistics  for  Cp  •••  • Correspondingly,  for 

rank  sequences  k^  we  have  the  same  cases  (i),  (ii),  and  (iii),  with 

the  s;ime  tenninolog)'  c.xtreme,  intcniiediate,  and  central,  respect  ively. 

Civen  a rank  sequence  k^  , to  distinguish  the  sequence  of  order 

statistics  resulting  from  the  two  possible  arrangements  (1.1.11  and 

(1.1.2),  we  may  say  the  variables  £ite  of  left  or  smallest  rank, 

(n) 

iind  the  variables  are  of  right  or  largest  rank.  Moreover,  we 

n 

may  identify  the  arrangement  with  which  we  are  dealing  by  calling  k^^ 

a sequence  of  left  or  right  ranks.  In  particular  we  call  the 

k-th  minimum  of  , ...  ,C  , and  , the  k-th  maximum  of 

1 n k 

. respectively,  for  eacli  n > k,  and  for  k = 1 we  merely 
say  mininunn  and  maximum. 

If  k^  is  a rank  sequence,  then  so  is  the  sequence  k^'^  given  by 

k'  = n - k +1,  and  we  clearly  have  the  relations 
n n ’ ’ 


J 


fW  . and  {W  . . . 

n n n 

'ITius,  for  example,  if  ^ “ but  n - + 1 equals  a fixed  positive 

integer  k for  all  n > k,  we  may  actually  regard  as  a sequence 

n 

of  k-th  largest  extreme  order  statistics.  Also,  if  k ->  <»  and 

kn  k^  . . " 

— -*■  1,  then  ^ 0,  and  is  in  fact  a sequence  of  largest  rank 

n 

intemediate  order  statistics. 

Hence  we  are  led  to  state  as  a definition  that  or 

n n 

is  a sequence  of  extreme  order  statistics  if  either  k^  or  n - k^^  + 1 

eqiuils  a fixed  positive  integer  for  all  large  n,  and  that  a rank 

sequence  k^^  is  increasing,  and  or  ^ is  a sequence  of 

n n 

increasing  rank  order  statistics,  if  both  ^od  n - k^  -*■  <“. 

For  increasing  rank  sequences  k we  will  always  assume  that 
k ^ 

X = lim  — exists,  0 < A < 1.  Other  possible  cases  which  we  will  not 
n 

consider  include,  for  example,  those  for  which  either  k or  n - k 

' n n 

is  bounded  but  without  limit. 

Since,  as  previously  noted,  our  investigation  is  founded  upon  the 
problem  of  asymptotic  distributions  of  order  statistics  from  i.i.d. 
sequences,  we  now  introduce  the  further  terminology  and  concepts  which 
are  relevant  to  that  situation. 

Thus  suppose  is  an  i.i.d.  sequence  with  marginal  distribution 

function  (d.f.)  FCxI  = < x) , and  let  k^  be  a rank  sequence.  Ke 

can  easily  obtain  the  distribution  of  : For  each  real  number  x 

n 


and  for  n > 1 define  the  r.v.  T (x)  = I Ir.  -i  , where  Ip  is 

^ i=l  ^’i“ 

the  indicator  r.v.  corresponding  to  the  event  F.  Then  w'^  have  the 


fundamental  relation 


4 


(1.1.3)  < x)  = P(T^fx)  > kj, 

from  which,  regarding  ^ binomial  r.v.  with  parameters  n 

and  F(x),  wo  readily  obtain 


d4'’'  = 4 ■ \ hthW  '"■'■'‘Hi  - nxj) 

n r=k  ^ 

n 


n! 


Tr-^rTTriT^Tni 


F(X)  k -1 

y a-y) 


n-k 


V ^0 

Similarly  we  can  obtain  the  distribution  of  , ^ 
n ^n 

'S,Fx)  = I we  have 

(^.1.4)  i'ij.  < x)  = P(lV^(x)  < kj, 

n 

so  that 

= -'I  ■ rT&FrlT  ''"‘''vX'  ' 


(n) 


n 


Tiy-ITTTH^TI' {„  ^ C-y) 


k -1 

Ily,  . ^ n 


dy. 

Now  writing 


dy. 


However,  it  turns  out  that  in  situations  of  interest  it  is  not  the  r.v. 

^"k^^  (o^'  ) itself  wiiich  has  a limit  distribution,  but  rather 

some  normalisation  of  it,  or  more  precisely,  the  r.v.  - b ), 

n 

where  {‘‘jp*),  b^^;  nsl}  arc  sequences  of  real  mmibers.  Tliis  corres- 
l)onds  in  an  analagous  way  to  the  usual  central  limit  theor>"  for  sums 
Sj^  = + . . . + of  r.v.'s,  wliere  in  general  has  no  limit 

distribution  itself,  but  may  under  suitable  standardization.  In  what 
follows  wo  consider  this  notion  fonnally. 

Perhaps  the  most  unnortant  ciucstions  in  the  study  of  asymptotic- 
distributions  of  order  statistics  from  i.i.d.  sequences  involve  the 
concept  of  attvaation . Suppose  for  some  sequences  of  const.'ints 


5 


a > 0,  b we  have  that 
n n 


a. 1.5) 

that  is, 

(1.1.6) 


4"’  - b 

k n 
n 


n 


->•  cl.  f . G as  n 


4">  - b 

k n 
n 


n 


s X 


GCx) 


I'or  all  continuity  points  x of  G.  'fhen  we  say  that  the  nuirginal 
d.f.  F of  belongs  to  tl\e  domain  of  attraction  of,  or  is  attract- 

ed to,  the  limit  law  G for  the  sequence  k^^  of  left  ranks,  'flie 
sccjuences  a^  > 0,  b^  are  called  normalizing  constants.  As  a particu- 
lar case,  if  k^  = 1 for  all  n,  we  say  that  F belongs  to  the  domain 
of  attraction  for  minima  of  G.  For  a given  rank  sequence,  the  classi- 
cal problem  of  limiting  distributions  of  order  statistics  consists  of 
first  finding  the  class  of  laws  G which  do  possess  a nonvoid  domain 
of  attraction,  and  secondly  finding  conditions  which  completely  charac- 
terize the  domain  of  attraction  of  each  possible  limit  law.  Of  course 
the  concept  of  attraction  also  applies  to  the  problem  of  limit  laws  for 
seciuences  of  largest  terms  j,  , and  as  a particular  case,  we  say 

that  the  imirginal  d.f.  F belongs  to  the  domain  of  attraction  for 
maxima  of  the  law  G if 


G 


I '1  J 

for  some  seciucnce  of  constants  a^  > 0,  b^  . 

It  is  easy  to  see  that  each  limit  law  is  in 
entire  "type"  of  limit  laws.  By  considering  the 
= a - b)  for  real  numbers  a > 0,  b,  it 


fact  a member  of  an 
transformed  sequence 


is  clear  that  if  for  a 
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given  nuik  sequence  , G(xJ  is  a limit  law  liaving  the  d.f.  l-(x) 
in  its  domain  of  attraction,  then  Gtax  + b)  is  also  a limit  law, 
whose  domain  of  attraction  includes  the  d.f.  r(ax  + b) . 

1-or  each  rank  sequence  k^^  and  for  any  d.f.  F(x)  it  can  he 
shown,  by  choosing  the  constants  a^  to  increase  sufficiently  fast, 
that  F belongs  to  the  domain  of  attraction  of  each  degenerate  law,  so 
that  the  degenerate  laws  contain  the  entirety  of  distributions  in  their 
domains  of  attraction.  Thus  we  exclude  convergence  to  degenerate  limit 
laws  from  furtlier  consideration. 


At  least  for  the  i.i.d.  case,  it  may  be  seen  that  all  results 
obtained  for  smallest  terms  c;in  easily  be  transformed  into  cor- 

resjionding  results  for  k^^-th  largest  temis,  and  conversely.  Letting 
ri|  = -Cj  we  trivially  have  that  the  are  i.i.d.  if  and  only  if  the 

are,  and  moreover,  ^ that 

n ^n 


Pfff”'  ■ a x + b } = Pf,  > -a  X - b ) 

'■  k n n^  '■k  n ir 


-1  -l'(^  <a„(-x)  -bj. 


Ihus  for  exam['le,  if  G(x)  is  a limit  law  for  k^^-th  smallest  toimis, 
which  contains  the  d.f.  F(x)  in  its  domain  of  attraction,  then 
1 - G(-x  - 0)  is  a limit  law  for  largest  tenns,  whose  domain  of 

attraction  contains  the  d.f.  1 - F(-x  - 0).  Ihis  sirniile  relationship 
pennits  us  to  freely  transfer  cur  attention  from  smallest  to  largest 
terms,  and  vice  ver.sa.  Additionally,  it  tums  out  that  all  possible 
limit  laws  in  the  extreme  and  intermediate  ranks  cases  are  continuovis, 
so  that  in  tliose  cases  G(.x)  is  a limit  law  for  a sequence  of  largest 
ranks  if  and  only  if  1 - G(-x)  is  a limit  law  for  the  same  sequence 
of  smallest  nuiks. 
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We  inention  here  that  the  framework  we  have  described  is  a special 

case  of  a general  "ranking  limit  problem"  foniiulated  by  Lobve  (1956). 

Considered  in  this  are  triangular  arrays  {f  -}  , , of  r.v. 's 

° ' n,j  n>l,lsj<m^-«“ 

and  the  asymptotic  distributions  of  temiis  , where  is  tlie 

^n  n 

It  is  easily  ^een  that  the 


k -th  smallest  ol  f ..... 
n •’n.l’  ’^n,m 

situation  we  are  dealing  with  is  the  special  case  in  which  C 
a^^(Cj  - b^) , where  a^,  b^  are  real  sequences  and  is  a sequence 

of  r.v. 's.  llus  generalization  of  course  corresponds  to,  and  in  fact 
is  motivated  by,  the  familiar  generalization  of  the  central  limit 
theorem  for  normalized  sums  of  r.v. 's  to  convergence  of  row  sums  from 
imiformly  as>'mptotically  negligible  arrays  to  the  infinitely  divisible 
limit  laws.  However  we  have  chosen  not  to  examine  this  more  general 
setting  in  our  investigation;  nevertheless,  we  have  found  that  Lobve's 
results  can  be  conveniently  specialized  to  our  sitviation  of  normalized 
order  statistics  of  sequences,  and  in  particular,  his  results  dealing 
with  the  problem  of  finding  the  asymptotic  joint  distributions  of  two 
or  more  extreme  order  statistics,  which  even  in  the  i.i.d.  case  has 
apparentl}'  rot  received  substtintial  attention  in  other  published  litera- 
ture. 


In  the  remainder  of  this  introductory  chapter  we  present  the  main 
results  dealing  with  limiting  distributions  of  order  statistics  from 
i.i.d.  sequences.  We  first  consider  extreme  order  statistics,  or  the 
fixed  ranks  case,  in  the  next  section,  and  in  Section  1.3  we  turn  to 
increasing  ranks.  Additionally  in  the  next  section  we  introduce  a 
highly  developed  theory  of  limiting  distributions  of  extreme  order 
statistics  when  the  i.i.d.  assinnption  is  relaxed,  and  more  specifi- 
cally, when  the  sequence  is  allowed  to  exhibit  dependence  of  the 


r 


8 

type  involvinjj  "mixing."  I-rom  this  we  might  expect  that  a similar 
theory  for  dependent  sequences  could  be  developed  for  increasing  ranks, 
I and  in  particular,  for  the  case  of  intermediate  order  statistics,  which 

in  some  sense  can  be  regarded  as  being  "close"  to  that  of  fixed  ranks, 
cunong  the  increasing  ranks  cases.  The  consideration  of  intermediate 
order  statistics  will  thus  become  the  focal  point  of  our  investigation. 

1 ,_2  Extreme  Order  Statistics. 

In  this  section  we  sketch  the  main  results  dealing  witli  the  theory' 
of  asy'iiiptotic  distributions  of  extreme  order  statistics  from  i.i.d. 
sequences  and  from  a class  of  dependent  sec{uences  to  which  the  tech- 
niques and  results  from  the  i.i.d.  case  have  been  found  to  conveni- 
ently extend.  In  discussing  these  results  we  will  primarily  consider 
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following  three  "types": 


1 

Gj(x)  = ^ 

0 

X 

< 0 

-a 

-X 

e 

X 

o 

A 

r - . 

X 

< 0 

1 i 

X 

O 

A! 

CjCx)  « e-' 

1 

8 

A 

X 

A 

8 

(a  > 0) 


(a  > 0) 


Put  another  way,  these  three  types  are  the  only  nondegenerate  laws 
possessing  a nonempty  domain  of  attraction  for  maxima.  We  note  tluit 
all  of  these  laws  are  continuous,  so  that  in  the  case  of  attraction, 
(1.2.21  holds  for  all  real  x.  Replacing  Ci(x)  by  1 - G(-x)  we  see 
that  the  possible  limit  laws  for  minima  are  given  by 


' 0 

X < 0 

G^(x)  = j 

(a  > 

0) 

a 

[ 1 - e'^ 

X > 0 

[ 1 - , 

X < 0 

G2(x)  = j 

1 

(a  > 

0) 

[ 1 

X > 0 

X 

G^lx)  = 1 - e'^ 

-a,  < X < oo. 

ft  is  perhaps  worth  mentioning  that,  as  is  the  traditional  usage  in  the 
study  of  extreme  order  statistics,  the  "type"  of  the  limit  laws  Gj(x) 
and  G2(x)  given  in  (1.2.3)  and  (1.2.4)  is  preserved  under  changes  in 
the  parameter  a > 0 as  well  as  under  the  usual  linear  transformations 
(location  and  scale)  of  the  argument  x. 

Necessary  .'ind  sufficient  conditions  comjiletely  specifying  the 
domains  of  attraction  of  the  {XDSsible  limit  laws  (1.2.3)  and  (1.2.4) 
are  given  by  Gnedenko  (1943),  and  more  recently  other  conditions  have 
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been  obtained  by  dc  Ilaan  (1970,  1971)  (see  also  Balkema  and  do  llaan 
(1972)  ).  Roughly  speaking,  membership  of  a distribution  in  some 
tlomain  of  attraction  depends  on  the  behavior  of  the  distribution  near 
its  (not  necessarily  finite)  right  endpoint,  and  similarly,  for  mininui, 
near  its  left  endpoint.  Rather  than  give  these  conditions  in  detail 
here,  we  only  provide  some  excimples  of  attraction  for  mjucima;  similar 
results  hokl  for  minima. 

(i)  bach  limit  law  belongs  to  its  oivn  domain  of  attraction  (cf. 
do  ilaan  (1970,  p.  61)  ). 

(ii)  f\ny  d.f.  I-  having  a finite  right  endpoint  such  that 

f'(xQ  - 0)  < 1 belongs  to  no  (nondegenerate)  domain  of 
attraction. 

(iii)  Ihe  Poisson  distributions  belong  to  no  donuiin  of  attraction. 

- 1-  7 

(iv)  The  standard  normal  d.f.  4>(x)  = (Zn)  exp(-’iy‘')dy  is 

i _(X) 

attracted  to  the  law  ('i-(x).  Specifically,  if  is  a 

secpience  of  independent  standard  normal  variables,  then 

-e'-'" 

-f-  e for  all  real  x, 

where 

a^^  = (2  log  n)'" 

(1.2.6)  and 

b^  = (2  log  n)  ^ - h(2  log  n)'''^(log  log  n + log  4tt)  . 

Tor  convergence  of  maxima  we  have  the  following  easily  proven 
relation  (see,  for  c.xcunple,  Cincdenko  (194S)  ),  where  x is  a real 
number  such  that  0 < G(x)  < 1; 


(1.2..'i) 


- b 


< X 
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(1.2.7)  f''\a  X + b ) ->■  G(x)  if  and  only  if 


n[l  - F(a^x  + b^)]  -log  G(x) . 

"T  fxl 

Writing  G(x)  = e ^ we  inay  equivalently  express  (1.2.7)  as 


(1.2.8)  P 


< X 


->  G(x)  if  and  only  if 

1 - P(a  X + b ) = + ofi-1 

^ n n n '■n'' 


For  minima  the  corresponding  relation  is 
(1.2.9)  P 


< X 


> G(x)  if  and  only  if 

F(a  X + b ) = + ofi) , 

^ n n-^  n '-n-'  ’ 

“T  fxl 

where  t(x)  is  defined  by  G(x)  = 1 - e ^ . In  addition  to  their 

usefulness  in  the  generalizations  to  other  fixed  ranks  (k  > 1) , which 

we  consider  below,  these  relations  correspond  to  analogous  results  for 

the  cases  of  order  statistics  of  increasing  rank. 

A problem  related  to  that  of  limiting  distributions  deals  with  the 

number  of  exceedances  of  an  increasingly  "high  level"  by  the  sequence 

of  r.v.s  . Specifically,  let  x be  a real  number  for  which 

(1.2.2)  holds  with  0 < G(x)  < 1 for  some  sequences  a^^  > 0,  b^^  . 

Define  the  r.v.  W = W (x)  to  be  the  number  of  exceedances  of  the 
n n 

"level"  u = u (x)  = a X + b by  f;.,  ...  ,f.  , that  is,  K = 

n n n n 1 ’ n n 

n 

I Ir_  1 , ;ind  let  p = p^^(x)  = 1 - f(Uj^).  Tlien  from  (1.2.8)  wc 
i=l  ^^i  n-^ 

have  that  np^^  x = i(x),  where  t(x)  = -log  G(x) , so  that  by  the 
familiar  Poisson  limit  theorem  for  binomial  r.v.'s,  W^  asymptotically 
has  the  Poisson  distribution  with  mean  x,  a fact  which  we  may  express 
by  writing 

I’(W„ 


-X 


• k-1 


k)  - e ‘ I K > 

r=n 
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F 


for  each  integer  k > 1.  Of  course  this  result  holds  for  all  x such 

that  0 < G(x]  < 1,  and  in  the  case  of  attraction  the  sequences  a^, 

do  not  depend  on  x.  Additionally,  it  is  clear  that  the  level  u^^  nuiy 

be  regarded  as  being  increasingly  "high”.  More  generally,  it  is  easily 

seen  to  be  true  that  if  u satisfies 

n 

(1.2.10)  n[l  - T,  0 < T < “, 


then  the  number  of  exceedances  of  the  level  u^^  by  ...  is 

asynptotical ly  Poisson  with  mean  t,  where  the  u^^  need  not  be  inter- 
preted to  be  of  the  form  u = a x + b . Tliat  is,  there  may  lie  exan- 
pies  in  which  the  number  of  exceedances  of  the  high  level  u^^  satis- 
fying (1.2.10)  would  be  of  interest,  but  in  which  the  marginal  d.f.  P 
belongs  to  no  domain  of  attraction.  We  might  point  out  however  that 
for  not  all  d.f.'s  P can  a sequence  of  levels  u^  be  so  chosen  (see 
Leadbetter  (1974b)  ).  Similarly  we  nu'iy  consider  the  number  of 
fj,  ...  which  are  less  than  or  equal  to  an  appropriate  u^  level: 

Suppose  now  that  u^^  satisfies 


nP(Uj^)  -I-  i , 0 < 1 < •». 

n 


Ihen  if  we  let  T = I I > 

i=l  ’i  n 

is  asymptotically  Poisson  with  me;m 
express  as 

P(T^  > k)  1 - e 


we  have  in  a like  manner  that 
r,  which  we  may  conveniently 


k-1  ^r 

y I- 

r * 

r=0  ‘ • 


1' 

n 


{ 


1 


for  each  k • 0.  This  problem  of  course  corresponds  to  that  of  limit- 
ing distributions  of  minima,  as  is  clear  from  the  fundamental  relation 
(1.1.3). 


J.3 


We  now  turn  to  consideration  of  arbitrary  extreme  order  statistics 
cind  see  how  the  previous  results  for  k = 1 are  extended.  Again  let 

be  the  k-th  largest  of  Cjf  •••  (n  > k) , where  k > 1 is  a 

fixed  integer.  Let  us  suppose  that  (1.2.1)  holds  for  some  sequences 
a^^  > 0,  b^  . From  (1.2.8)  along  with  the  fundamental  relation  (1.1.4) 
and  the  Poisson  result  of  the  last  paragraph,  we  find  that 


a 

n 


k-1 
fi(x)  I 
r=0 


log  (j(,X) 

r-' 


1 

XFTTT 


-log  G(x) 


e ^ ^ dy  , G(x)  > 0 


, G(x)  = n, 


for  all  real  x.  It  is  apparent  that  the  possible  limit  laws  for  k-th 
largest  terms  include  the  following  three  types: 


C>\  (x)  = 


x ^ 0 


; ^ y^  ^ dv  , X > 0 


(a  > 0) 


(1.2.11)  g!,''^x)  = 


e ^ y^  ^ dy  , x < 0 


X > 0 


(a  > 0) 


*-■3  " IFITT 


-y  k-1  , 
e >■  dy 


-oo  < X < 


By  Smirnov's  (1952)  generalisation  of  the  results  for  the  case  k = 1, 
these  laws  arc  in  fact  all  the  possible  limit  laws  for  k-th  hugest 
order  statistics,  for  each  k > 1.  Moreover,  the  conditions  for  the 
domains  of  attraction  for  mjLxima  (k  = 1)  are  also  ncccssar>'  and 


sufficient  for  arbitrary  k > 1,  so  that  if  a d.f.  F belongs  to  the 
domain  of  attraction  of  the  law  for  some  k,  then  it  is 
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attracted  to  tiie  corresponding  law  for  all  k 5 1.  These  results 

follow  from  the  relation 
^(n) 


(1.2.12)  P 


- b 


< X 


G(x)  >0  if  and  only  if 
n[l  - F(a^x  + b^)]  > v(x)  , 


where  v(x)  is  defined  by  the  equation 


v(x) 


e*y  y^'^  dy  = G(x) , 


wliich  generalizes  (1.2.7).  (For  a recent  proof  of  these  facts,  see 
Lcadbetter  (1977)  ).  We  note  also  that  when  we  do  have  attraction,  we 
may  take  norirual iz ing  constants  a^,  b^  not  depending  on  k.  Of  course, 
similar  results  hold  for  k-th  smallest  order  statistics,  and  these  may 
be  found  explicitly  stated  in  Smirnov's  paper. 

Of  perhaps  at  least  as  much  interest  as  that  of  1 uniting  distribu- 
tions of  k-th  maxima  or  minima  is  the  question  of  the  as>’mptotic  joint 
distributions  of  two  or  more  extreme  order  statistics.  As  one  might 
ex]iect,  it  is  somewhat  comj)licated  to  write  down  such  distributions  in 
iin  explicit  fonn.  However,  Lobvc  (1956)  has  obtained  a representation 
for  these  limit  laws  which  is  fairly  easy  to  deal  Vv'ith,  and  in  fact  for 
the  more  general  ranking  problem  mentioned  in  the  previous  section. 

Here  we  specialize  his  results  to  our  situation  (see  Miller  (1976)  ). 

Let  1 (x)  be  a nondecreasing,  nonnegative,  and  not  necessarily 
finite-valued  function  on  the  real  line.  Let  y be  the  measure, 
defined  on  the  Borel  sets  of  the  real  line,  whose  value  at  a semicloscd 
interval  (x,y]  is 

r(y+0)  - t(x+0)  , if  t(x+0)  < “ 

0 , if  t(x+0)  = <». 


h^(x,y]  = 
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Tlien  the  stochastic  process  1 = {I (x) , -<»  < x < <»}  is  called  t- 
Poisson  if  1 is  the  Poisson  process  with  intensity  measure  ; that 
is,  for  each  real  x,  l(x)  is  a Poisson  r.v.  with  mean  p^(-“,x],  and 
for  any  real  x^  < ...  < x^  for  which  t(x^)  < the  r.v. 's  l(Xj), 

Ux-7) ■ I , ...  ’ ^ ^ independent.  The  random  vector 
(l(xj),  ...  is  called  an  independent  inorement  Poisson  vector 

with  mean  (y(-°“,Xj^],  ...  ,p('«>,x^]).  Here,  we  define  the  Poisson 
(extended)  r.v.  with  mean  +“  to  be  equal  to  +“>  almost  surely.  In 
particular,  if  t is  continuous  and  if  lim  t(x)  = 0,  then 

X->-oo 

M.^  (-“>,x]  = t(xJ  and  y^(x,y]  = x(y)  - t(x)  for  all  real  x,  y,  where 
wc  define  - oo  = o. 

Now,  if  t(x)  is  nonincreasing,  nonnegative,  and  not  necessarily 
finite-valued,  then  we  call  the  process  J = {J(x),  -<»  < x < “} 
reverse  \ -Poisson  if  the  process  I = {I(x),  -a.  < x < “}  defined  by 
I (x)  = J(-x)  is  T-Poisson,  where  x(x)  = x(-x).  Then,  for  each  real 
X,  ,J(x)  is  a Poisson  r.v.  with  mean  p— (-“,x],  and  for  any  x^  < ... 

< x^  for  which  x(Xj)  < the  r.v.'s  J(Xj)-J(x2),  ...  ,J(Xj^_j) -Jfx^^) , 

.J(x^)  are  independent.  The  vector  (J(x^),  ...  ,J(x^))  is  called  a 
reverse  independent  increment  Poisson  vector  which  mean  (y— (-“’jXj], 

...  ,y— (-°°,x^]]  . If  X is  continuous  Jind  if  lim  x(x)  = 0,  then 

X-x» 

lj_(-oo^x]  = x(x)  and  y— (x,y]  = x(x)  - x(y)  for  all  x,  y. 

Suppose  now  that  is  an  i.i.d.  sequence  with  marginal  d.f.  P 

and  that  there  are  constants  a > 0,  b such  that  (1.2.1)  holds. 

Tlien  Lobve  (1956,  Theorem  4)  has  shown  that,  for  any  finite  number 
kj,  ...  of  fixed  largest  ranks. 
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A ic 

as  n where  the  joint  distribution  of  the  r.v.'s  , C , •••  n,  C 


is  given  by 


'S. 


(1.2.13)  ...  .g  . P{J(xp<kj J(xj-g. 

for  -<«<Xj  < ...  < < °°,  wliere  J = {J(x),  -oo  < x < “i}  is  the  reverse  x- 

Poisson  process  with  x(x)  defined  by  G(x)  = e ^ . Moreover,  any 

limiting  joint  distribution  for  a finite  number  of  fixed  largest  ninks 
must  be  of  this  form,  and  as  was  the  case  for  the  one -dimensional  limit 
laws,  the  attraction  of  the  maximum  (k  = 1)  is  also  neces.sary  for  ajiy 

siKh  (nondegenerate)  limiting  joint  law  to  exist.  In  a similar  way  for 

simillest  ranks  k^ , ...  ,k^^^  , the  relation  (1.2.9)  holds  if  and  only  if 


I n 


d"’  - b. 


m 


I ''n 


, 


as  n > «>,  where  for  -a>  < x,  < ...  < x < <» 
’ 1 m 


(1.2.M)  pg  ...  ,5^  «j  - p(i(xj)xkj ug^kj. 


m ■ "m 

where  I = {l(x),  -oo  < x < «>}  is  the  x-Poisson  process  Vv'ith  x(x) 
satisfying  G'x)  = 1 - c . 

A result  parallel  to  these  representations  is  immediate,  .ukI  wiiich 

we  state  only  for  largest  ranks.  Suppose  (1.2.1)  liolds  and  as  defined 

n 

previously,  let  IV  (x)  = T Ir^  ^ r -i  i > where  u (x)  = a x + h , 

' ' n ■ , L^-»J  (x)J  ’ n^  ^ n n 

i = l ‘-^1  n 

for  -“  < X < “1.  Iliis  defines  a sequence  of  stochastic  processes 

= (W  (x)  , -°°  < X < 0°} , and  it  is  clear  from  the  fiuidamental  rela- 


tion (1.1.4)  that  the  finite-dimensional  distributions  of  W 


.(n) 


con- 


verge to  those  of  J = (.I(x),  -0°  < X < »}.  It  is  possible  th;it  ques- 
t ions  regarding  the  weak  convergence  of  the  processes  in  an 

appropriate  space  of  functions  on  the  (entire)  real  line  wouki  1h'  of 


r 
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interest,  including  when  the  are  no  longer  i.i.d.  but  satisfy 
dependence  conditions  which  we  discuss  below;  however  we  have  chosen 
not  to  consider  these  here. 

We  indicate  that  we  may  also  formulate  a related  multi-level  ex- 
ceedances problem,  when  appropriate  u^  levels  can  be  chosen,  and  for 
cases  in  which  the  marginal  d.f.  of  the  sequence  does  not  neces- 
sarily belong  to  a domain  of  attraction  for  maxima.  This  of  course  is 
an  extension  of  the  single  level  problem  already  discussed.  For  a 
given  integer  m > 1 let  us  choose 

0 < X < ...  < <00 


and  for  each  M = 1,  ...  ,m,  suppose  the  level  u^*^^  satisfies 


(y) 


1 - F(u^^^)  = + o(i)  . 

'■  n n '■n-' 


Ilien  upon  defining  = 'I  1 , we  have  that  for  Jiny  non- 

negative integers  k^,  ...  ,k^  , 

P(wJ^^^=kj,  ...  ,W^"'^=kJ  - P(j(t^^^l=k^,  ...  ,J(T^'"^)=kJ 

as  n ►0°,  where  ...  is  the  reverse  independent 


increment  Poisson  vector  with  mean  ...  Similarly,  if 

instead,  for  0 < < ...  < if  the  level  u^^^^  satisfies 

. o(h, 

'•  n ■'  n '■n-' 

a = I,  ...  ,m,  then  letting  = y 1 , we  have 

" i-l 

i'(T''*.k| C-U  - p(i(T'*’)-k, 


(m) 


where  (l(t 


(I) 


is  the  independent  increment  Poisson 
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.(1) 


vector  with  mean  (x 

To  complete  our  discussion  of  limitinj>  joint  distributions  of 
fixed  nmk  order  statistics  from  i.i.d.  sequences,  we  illustrate  the 
use  of  the  above  representations  by  computing  the  asymptotic  Joint 
distribution  of  the  maximum  and  the  second  nuiximum  , 

when  11.2.1)  holds.  Write  G(x)  = e and  let  J be  the  reverse 

X'l’oisson  process.  For  s x.,  such  that  Ci(x2)  > 0,  or  equivalently, 


t(x,)  < we  have 

f,d'"  -h 

Ii«.  !■  -hr—" 

n n n 


" < X, 


= P(j(xp=0,  J(X2)^1) 
= P(J(X])  = 0) 


-Tlx, 


= e 


= Glx.,), 


since  J(x^]  - Jix-,1  is  nonnegativc.  If  G(x,)  = 0,  then  r(x^)  = °° 
and  thus  also  t(x^  = since  x is  non  increasing,  so  that 
GlXj)  = 0;  hence  J(x^)  = IIXt)  = almost  surely  and  therefore 
P(j(Xj^)=0,  .Ilx-,)<l)  = 0 = G(Xjl.  For  x^  > x^  such  that  G(xh  > 0 


we  have 


Urn  P 
n 


f 

1 ' 


< 


X 


r 


a 


n 


< 


= P(J(x^)  = 0,  J(x,)  S 1] 

1 

= I P(J(X  ) = 0,  J(xh-d(x  ) = j) 

i=n  ' “ ' 

1 

= I P(dlx,)  = 0)p(,J(xh-.Ilx,)  = j) 
j=0  ‘ I 

-r(Xj) 

= e 

-T(xh 

= e “ (l  + t(x2)  - tlx^)) 


(TlX,; -TlXj 


(l  + x(x,)  - 
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= G(x^)  1 + log 


G(xJ 


GI3^ 


aiul  the  same  conclusion  also  holds  for  G(x2)  =0  if  we  interpret  the 
last  expression  to  be  zero,  ilius  we  have  shorn  that  if 

->  d.f.  H(Xj,X2) 


- b 

1 n 


a 


< X 
- 


< X, 


as  n for  all  continuity  points  (x^,X2)  of  II,  then 

the  form 


is  of 


Cl. 2. 15)  1!(x^,X2)  = 


G(xJ, 


X2  and  G(x2)  = 0 


G(x2)c1  + log  » X]  > X2  and  G(X2)  > U 

G(x, 


'r 


Xi  < X2 


where  G is  the  one -dimensional  limiting  distribution  of  the  nonnal- 
ized  maximum  ‘ ^'’^1  > which  necessarily  exists.  This  agrees 

with  the  ex]iression  given  by  Welsch  (1972,  Lemma  1),  who  obtained  it 
from  alteniative  calculations.  We  might  mention  that  this  result  is 
also  valid  if  G is  degenerate,  although  it  may  be  seen  that  in  sudi 
a case  li  is  also  (;md  conversely,  if  a two-dimensional  law  H of  the 
above  form  is  degenerate,  then  so  must  be  G ). 


A considerable  ;unount  of  research  has  been  directed  toward  the 
development  of  a corresponding  theory  of  the  asymptotic  distributions 
of  extreme  order  statistics  of  sequences  of  r.v. 's  which  are  not  neces- 
sarily i.i.d.  In  most  instances  the  identically  distributed  assinription 
is  retained,  ;ind  in  fact  strict  stationarity  is  assumed,  and  the  depen- 
dence structures  considered  involve  conditions  related  to  "mixing.” 

One  such  condition  is  that  of  "strong  mixing,"  which  we  say  is  satis- 
fied by  the  sequence  if 
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as 


1 ► 


(1.2.10)  sup  sup  iPC/M^J  - P(A)r(B)|  ::  i;f!l)  1 0 

JM  A..?,, 

for  some  "mix Lug''  fiBiction  (sequence)  g(2.) , where  • aiul  ^ . 
are  respectively  the  o-fields  generated  by  , ...  ,Cj]  and 
^ 'i+Ji,’  ^j+K+r  examiJle  we  mention  that  the  strong  mixing 

condition  is  oln-iously  satisfied  by  m-dependent  sequences  , by 
uhich  we  mean  that  for  each  j > 1,  the  o-fields  ;md 

are  independent,  and  hence  g(?,)  = 0,  if  J?.  > m.  Although  the  asynptot  • 
i>  theory  for  extreme  order  statistics  has  been  considered  for  other 
tyjK's  of  dependent  sequences,  for  e.x;imple  Markovian,  it  is  the  strong 
mixing  and  related  dependence  conditions  to  which  extensions  of  the 
methods  and  results  of  the  i.i.d.  theory  have  been  found  to  be  particu- 
larly well  suited.  Moreover,  the  case  of  stationary  normal  sequences 
conveniently  fits  into  the  general  framework,  and  here  the  dependence 
conditions  may  be  fonnulated  in  terns  of  covariances,  which  as  is  well 
known  provide  for  a complete  characterization  of  nontial  sequences.  In 
the  remainder  of  this  section  we  state  some  of  the  results  that  have 
been  obtained,  including  those  valid  inider  conditions  weaker  th.'iii  but 
related  to  strong  mixing. 

Thus  suppose  is  a strictly  stationary  sequence  satisfying  the 

strong  mixing  condition  (1.2.1C)),  and  let  = m;ix{r,j,  ... 

Ixyvnes  (IPtw'i)  has  shown  that  the  three  limit  t\j)es  result  of  the  i.i.d. 

case  is  also  valid  here;  that  is,  if  (1.2.1)  holds  for  some  constants 

a ■ 0,  b , tlien  t’>  is  necessarily  of  one  of  the  three  t\nes  listed 
n II 

in  (1.2..-^). 

Since,  howevx'r,  the  strong  mixing  condition  is  rather  restrictive 
and  somewhat  diffinilt  to  verify  in  practice,  it  being  necessary  to 
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consider  all  pairs  of  events  in  the  a- fields  '3',  ■ and  ^ „ . and 

moreover,  since  not  all  of  the  events  generated  by  the  r.v. 's  arc 
actually  relevant  to  the  study  of  the  maximum  tenn  , one  might 

hope  that  the  strong  mixing  condition  could  be  weakened  while  still 
retaining  the  three  limit  types  result.  This  motivation  has  led  to 
tlic  following  condition,  proposed  by  Leadbetter  (1974b,  1977).  Let  u^ 
be  any  sequence  of  real  numl)ei's,  and  for  a finite  set  of  integers 
i,,  ...  ,i  let  F.  . (u  ) = <u  , ...  ,C-  su  1. 


U(u  |lq 


. (u  ) - F. 
1 '•  1 


" M ’ ■ ■ ■ ’ ^’■*1’ ■ ■ ■ ^ '1’’ 

for  ;iny  integers  l<ij^<...<ip<jj^ 
where  g^^  ^ is  nonincreasing  in  Z and 


- (u  )F.  . (u  ) I £ g 


< j < n, 
-'q 


- 1 


n,fc 

Z, 


limg  j • 0 
n ’ n 


for  some  sequence  ™ and  = o(n) 


Suppose  is  stationary  and  that  (1.2.1)  holds.  Leadbetter  has 

shown  tint  if  D(u  ) is  satisfied  for  the  sequence  u = a x + b for 

all  real  x,  then  the  limit  law  C must  be  of  one  of  the  three  t>j>cs 

(1.2.3).  It  is  clear  that  the  reciuirement  that  IHu^^)  hold  for 

u = a X + b for  each  x is  indeed  a weaker  condition  thaji  strong 
n n n 

mixing,  there  being  fewer  pairs  of  events,  and  only  events  of  a certain 
form,  which  need  be  considered. 

From  these  resvilts  we  might  then  conjecture  that,  under  the  same 
conditions,  for  other  fixed  rank  terms  Joint  dis- 

tributions of  two  or  more  fixed  rank  terms,  the  possible  limit  laws  are 
the  same  as  those  which  can  arise  under  the  i.i.d.  assumption.  However, 
this  is  not  correct,  and  thus  apparently  under  the  dependence  conditions 


wo  arc  considering  the  generalization  of  the  i.i.d.  three  limit  t>"[)es 
result  is  peculiar  to  the  (first)  maximum.  We  illustrate  with  tlie 
following  simple  example  giv'en  l)y  Welsch  (1972J  for  the  nne-dimens  iona  1 


case  k = 2 

some  a • 
n 


hot 


he  i.i.d.  wi  til  margina  1 d.f.  F and  sup]iose  lor 


0.  h we  liavc  that  F (a  x + li  ) • Gfx)  for  all  rea 
n ■ n n 


x; 


tliat  is,  F belongs  to  tlie  domain  of  attraction  for  maxima  of  the 


limit  law  G.  Now  define  .f  = iiklxIz  , z n 1.  flien  is 

n n n+1  n 

strictly  stationary  and  satisfies  the  strong  mixing  condition  (1.2.10) 
and  in  fact  is  1 -dependent,  and  we  hare  that 

,{n) 


- h 


< X 


G(x) 


for  all  X.  IVe  concliule  that  the  possible  limit  laws  for  second  maxima 
include  those  for  first  maxima,  so  that  Smirnov's  geiu'ral izat ion  of  the 
three  types  resiilt  no  longer  is  valitl.  Results  further  indicating  the 
actual  size  of  the  class  of  possible  limit  laws  for  the  case  k = 2, 
and  for  the  Joint  l.iws  of  first  aiul  second  maxima,  have  been  obtained 
by  belsch  (1971)  and  Moi'i  (19'^b).  I'resiunably  more  complicated  result! 
could  as  well  be  obtained  lor  the  cases  k > 2 and  for  other  joint 
ranks . 


.\notlu'r  and  telated  problem  of  significant  interest  is  to  tictually 
find  the  limiting  dist  ribut  ions  of  extreme  order  statistics  from  tle]H'n 
dent  sei)uences,  and  in  jiarticular,  for  what  is  probably  the  situation 
most  useful  and  easiest  to  handle,  to  show  that  the  limiting  law  of  a 
setiuence  of  teniis  I normti  1 i zed)  is  the  same  as  if  the  were 

in  fact  i.i.d.,  assuming  this  exists.  To  deal  with  the  problem,  for  a 
given  stationaiy  .sc()ucncc  we  let  be  an  i.i.d.  sequence  of 

r.v.'s  with  the  s;uue  marginal  d.f.  as  may  be  called  the 
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"independent  sequence  associated  with  " (cf.  Loynes  (1965)  J.  We 
let  denote  the  k-th  largest  of  f,j , . . . , for  each 

n > k i 1. 

As  suggested  by  the  1 -dependent  example  given  above,  even  fairly 
stringent  mixing  assumptions  would  not  be  sufficient  to  guarantee  that 
iuid  (normalized)  have  the  s;»me  asymptotic  distribution, 

when  these  exist,  and  hence  additional  eissumptions  must  necessarily  be 
iiuidc.  for  the  case  k = 1 a condition  leading  to  a result  of  the  kind 
desired  has  been  formulated  by  O'Brien  (1974).  Let  be  a real 

sequence  such  that  ^ 1 where  F is  the  marginal 

d.  f.  of  the  stationary  sequence  , assuned  to  satisfy  the  strong 
mixing  condition  (1.2.16). 


Rj:  There  exist  sequences  of  positive  integers 

that,  as  n ‘ «>,  r^  <■  rj^8(qp)  ^ 0,  p^^)^ 

p -1 

^1T-F(u  ))  ^^^n  ■ ’ ^'i+1 

'n''  n 1 = 1 n 

where  = ip(Pp  - Mp) • 


^n  ’ *^n  ’ 
-►  0,  and 


>u  ) ->  0, 

^n 


anti 


r 


n 


such 


O'Brien  has  shown  that  for  constants  a^  > 0,  b^  , 


1 n ^ 

->■  G(x)  if  and  only  if  P 

^ A 

a 

a 

n 

n 

for  0 < C(x)  < 1,  if  R^  holds  for  the  sequence  u^  = a^x  b^^  . 
(Loyaies  (1965)  originally  showed  the  "if"  part,  using  r^  = n.)  Of 
course,  that  R^  should  hold  for  u^  = a^x  + b^  for  each  x is 
sufficient  for  the  limit  laws  of  and  to  coincide. 

O’Brien  also  gives  an  ex;imple  for  whicli  Rj  is  not  satisfied  for  all 
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;md  for  which  the  limiting  distributions  of  and 

exist  but  actually  differ,  though  still  being  of  the  same  type 
(which  would  correspond  to  a change  in  the  nomalizing  constants  a^  , 

I'he  situation  for  other  fixed  nmks,  and  for  joint  distributions, 
has  also  received  attention.  As  a particular  ex;unple,  for  the  joint 
distribution  of  the  first  and  second  nmirrui,  Welsdi  (1971)  has  shovvn 
that  under  strong  mixing  and  (mother  condition  of  a type  similar  to 
Rj  , the  joint  limit  law  ll(Xj,x^)  is  the  same  as  if  the  were 

i.i.d.,  that  is,  of  the  form  given  by  (1.2.15).  Implicit,  of  course, 
is  the  requirement  that  this  (nondegenerate)  joint  law  exist,  which  as 
wc  know  is  equivalent  to  the  condition  that  the  first  maximimi  (nor- 
malized) have  a nondegenerate  limit  law. 

The  search  for  conditions  weaker  than  strong  mixing  to  use  in 

establishing  that  tiie  maximimi  of  a stationary  sequence  has  the  same 

limiting  distribution  as  it  would  if  the  sequence  were  i.i.d.,  has  been 

motivated  by  the  follow'ing  result  of  Rcnnan  (19fi4)  : If  ^ is  a 

stationary  nonnal  sequence  having  zero  means,  luiit  variances,  and 

covariances  r = 1-,  ,,  , and  if  either 

n 1 P+1 


(1.2.17) 


r log  n <■  0 
n ^ 


as  n + 


or 

(1.2. 18) 


tlien 


00 


I 

n=l 


r < 0°, 
n ’ 


1 


a 

n 


-e 


-X 


I 


< X 
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1 

i 

for  all  real  x,  where  a^,  are  given  by  (1.2.6).  Since  there  is 
no  general  relationship  between  strong  mixing  and  (1.2.17)  or  (1.2.18), 
e.xcept  that  strong  mixing  implies  (1.2.18)  (see  Deo  (1973a)  ),  the 
nonnal  case  cannot  be  included  in  the  result  of  O'Brien  and  Loynes. 
However,  Leadbetter  (1974b)  luis  established  a relationship  between 
these  covariance  conditions  for  the  normal  case  and  conditions  appli- 
cable to  general  stationary  sequences  which  lead  to  the  desired  con- 
clusions, !)>•  again  employing  Ihc  following  condition  simi- 


lar to  R 


1 • 


n-1 


D'(u  ):  lim  n > P(Ci>u  , ] = of-1  as  r ->■ 

>.  n-'  .c  '■'’1  nr’  ^l  + i nr-*  '-r^ 

n 1=1 


Leadbetter  has  sliown  that  i 


if  ^ 


a-^(i 

n M 


(n) 


>'»  ) 
n-' 


<■  G and  if  both 


l)(u  ) and  1)'  (u  ) hold  for  each  u = a x + b , then  for  every 
^ n n n n n ^ 


k > 1, 


-(n)  , 

k'i  ‘’n 


a 


< X 


n 


r.(x)  V 

s=0 


S ! 


as  n for  all  real  x,  where  the  right  hand  side  is  defined  to  be 


-(n) 


:(n) 


zero  if  G(x]  = 0.  That  is,  and  have  the  same  asympto- 

tic distribution,  md  under  the  same  nomvilization,  for  all  k > 1. 
this  result  for  k > 1 follows  as  a corollary  to  the  more  general 


i’oisson  convergence  of  the  number  of  exceeckmces  by  , . . . of 

the  level  u^  satisfying  n(l  - F(u^)]  -►  x,  T being  the  m;irginal 
d.f.  of  , which  we  have  seen  to  hold  in  the  i.i.d,  case,  and  whicli 
Leadbetter  has  shown  to  also  hold  for  stationary,  dependent  sequences 
under  both  tl\e  conditions  and  D'(Uj^).  Moreover,  in  the  nonnal 

case  either  of  the  covariance  conditions  (1.2.17)  or  (1.2.18)  imply 


both  D(u  ) and  D'(u  ) for  u = a x + b for  all  real  x,  where 
n n n n n 
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are  given  by  (1.2.6),  a fact  which  let.s  us  regard  the  result  of 
Bennan  as  a special  case  of  a result  for  more  general  dependent  se- 
quences. It  is  perhaps  worth  mentioning  that  it  has  more  recently  been 
established  (see  Leadbetter,  et.  al.  (1977)  ) that  these  results  for 
normal  sequences  are  also  valid  if  the  covarijinces  r^^  satisfy 

|log  j 

(r.)(log  j)c  ■’  -»•  0 as  n > " 

1 J 

ior  some  y > condition  somewhat  weaker  than  either  (1.2.17)  or 
(1.2.18). 

I'inally  in  this  section  we  remark  that  it  is  of  interest  to  con- 
sider other  types  of  situations  in  which  there  are  limiting  distribu- 
tions of  extreme  order  statistics  from  stationary,  dependent  sequences. 
One  such  result  has  been  obtained  for  the  maximum  tern  (k  = 1)  of  a 
stationary  nonmil  sequence  by  Mittal  and  Ylvisaker  (1976),  who 
have  shovvn  that  under  a different  but  equally  meaningful  covariance 
condition  for  which  ( 1 . 2. 17) - (1 . 2. 19)  (and  hence  the  strong  mixing 
condition)  necessarily  fail  to  hold,  the  maximimi  term  is  actu- 

ally asymptotically  nonnal,  with  normalicing  constants  a^,  b^^  differ- 
ent from  tliose  given  by  (1.2.6).  Here  it  would  be  interesting  to  see 
what  are  the  limiting  distributions  for  other  fixed  ranks,  ;ind  for 
joint  r;mks,  if  these  exist.  .Another  problem,  pertaining  to  general 
stationary,  dependent  sequences,  would  involve  determining  if  it  can 
happen  that  the  fixed  rank  terms  of  a sequence  hav^e  limiting 
distributions  vvhile  those  of  the  associated  independent  sequence  do 
not,  that  is,  the  marginal  d.f.  belongs  to  no  domain  of  attraction.  Of 
course,  for  example,  for  strongly  mixing  sequences  such  would  require 
some  "large  degree"  of  dependence  between  the  r.v.'s  and  f,.  when 


(1.2.19)  r -0  iind  - )' 
n n 

1 = 
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|i-jl  is  "small,"  in  order  that  O'Brien's  condition  not  hold. 

We  leave  such  questions  as  these  open,  however,  along  with  poten- 
tial analagous  results  in  the  case  of  increasing  ranks.  In  fact,  when 
dealing  with  that  case  we  will  only  consider  the  problem  of  obtaining 
general  dependence  conditions  insuring  that  the  asymptotic  distribu- 
tions of  the  increasing  rank  order  statistics  of  a stationar>’  sequence 

f are  the  same  as  if  the  (,  were  i.i.d.,  where  we  assuiie  the  latter 

n 

exists. 

1.3.  Order  Statistics  of  Increasing  Rank. 

We  now  discuss  the  theory  of  asymptotic  distributions  of  sequences 

of  order  statistics  or  , , where  the  Q are  i.i.d.  and 

k^  is  an  increasing  rank  sequence.  Extensive  studies  of  the  possible 

limit  laws  and  their  domains  of  attraction  have  been  made  by  Smirnov 

(11)52,  1967),  Chibisov  (1964),  Cheng  (1965),  and  Wu  (1966).  In  all 

k 

cases  considered  it  is  assumed  that  the  relative  rank  sequence  — 
tends  to  a limit  A,  0 < A < 1,  as  n and  the  results  obtained 
depend  upon  the  value  of  A and,  when  0 < A < 1,  upon  how  rapidly  the 
sequence  of  relative  ranks  converges.  Since  in  most  instances  siruillest 
increasing  rank  order  statistics  rather  than  largest  have  been  con- 
sidered, we  will  here  primarily  deal  with  sequences  of  snvillest 

n 

terms . 

An  important  and  useful  preliminary  result,  corresponding  to 
(1.2.7)  and  (1.2.12)  for  fixed  ranks,  is  the  following,  which  was 
originally  given  by  Smirnov  (1952);  Let  be  i.i.d.  with  nuirginal 
d.f.  F.  Ihen  for  given  constants  a^  > 0,  b^  , the  relation 


2« 


(1.3. laj 

holds  if  ;uid  only  if 


- b 

k n 
n 


< X 


n 


G(x) 


(1.3.1b) 


F(ci  x+b  ) - — 
n n n n 


/r 

n 


J7^ 


u(x) , 


as  n where  u(x)  is  defined  by 


C.(x)  = 'ffutx)), 


'!>  being  the  stemdard  nonnal  d.f.  For  a central  rank  sequence  k , 
k " 

— • X,  0 < A < 1,  (1.3.1b)  may  be  wrritten  as 


(1.3.2) 


F(a  x+b  ) - — 

/n  u(x) , 

/xrF'xT 


and  for  an  intennediate  rank  sequence  k^  and  for  x such  that 
n < C(x)  < 1,  (1.3.1b)  becomes 

k u(x) 


(1.3.3) 


F(a  X + b ) = — ' + 
n n n 


n ^ n 

+ o 

n n 


Similar  relations  of  course  hoUi  also  for  sequences  of  largest  teniis 
^ , and  by  considering  the  increasing  rank  sequence  k^!^  given  by 
k^  = n - k^^  + 1 , it  is  easy  to  show  that,  as  an  example,  for  the  par- 
ticular case  that  k^^  is  an  intermediate  sequence  of  right  ranks,  for 
X such  that  0 < G(x)  < 1,  we  have 


< X 


G(x) 


if  and  onlv  if 


k ulxlvlc” 


rvdr- 


(1.3.4)  1 - F(a  X + b ) = -2- 

n n n 


+ o 
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where  G(x)  = 4>(u(x)). 

As  in  the  fixed  ranks  case,  we  may  also  consider  a related  problem 
involving  the  number  of  exceedances  of  an  appropriate  level  by  the 
sequence  of  r.v. 's  . In  particular,  for  intermediate  rank  se- 
quences k^  , let  u be  a given  real  number  and  suppose  the  level  u^ 
satisfies 


(1.5.5) 


uA 


1 - F(u^)  = H + o 

n-^  n 


n 


n 


Now  let  IV  = 
n 

Cj,  ...  . 


I Iff;  >u  I number  of  exceedances  of  u by 

i=l  ^^i  n-^  ^ 

Tlien  we  have  that 


(1.5.6) 


l’(hj^  < k^)  ->  5>(u)  as  n 


a result  which  is  clear  from  the  following  lemma,  which  we  will  also 
employ  for  other  purposes  in  Chapter  II. 


Lemma  1.5.1. 
(1.3.7) 


If 


0 < < 1 


is  a sequence  satisfying 


p = ^ " . o pl 

‘n  n n ( n 


for  some  real  number  u,  and  where  k^^  -*■  <»,  k = o(n),  then 

k ’ 

(1.3.8)  Qprd  - P.)"’'‘-4(u). 

r=0  ” 


The  result  is  also  valid  if  the  upper  limit  of  summation  is  ■ 1 

instead  of  k , 
n 


t’roof:  This  follows  from  Lemma  1.4.1  of  Leadbetter  (1977),  which  is  in 

fact  more  general,  but  for  completeness  we  give  a proof  here.  Let 

X, , ...  ,X  be  i.i.d.  Bernoulli  variables  with  mean  p . llien 
1 n 
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I (jp„u  - P ) = p(  I X.  < k ) 

.,rn  *^n  '•>1  1 n-* 

r=()  1=1 


(1.3.9) 


= P 


y X.  - np  , 

>1  1 *n  k - 

1=1 


np 

n ' n 


/np  (1-p  ) /np  (1-p  ) 


l-'rom  the  Berry-Pssecn  bound  (see,  for  example,  van  Beek  (1972)  ) we 
have 


n 

f y X-  - np  , 

■ ^ , 1 ‘ n k - np 

1=1  n * n 


/np  (1-p  ) /np  (1-p  ) 
Ml  Ml  'n  ‘n 


- $ 


k - np 
n ^n 


/np  (1-p  ) 
*^n^  *^n 


for  some  constmit  C,  not  depending  on  n.  Now  from  (1.3.7)  the  right 
side  tends  to  zero,  while 


k - np 
n *^n 

»4ip  (1-p  r 
^n  ' n 


u. 


riiis  along  with  (1.3.9)  gives  (1.3.8). 

In  a similar  way  we  may  consider  the  number  of 


which 


do  not  exceed  a suitably  chosen  level,  which  corresponds  to  the 

problem  of  limiting  distributions  for  smallest  order  statistics, 

again  where  k^  is  an  intennediate  rank  sequence.  For  a given  real 
number  u,  we  now  suppose  the  level  u^^  satisfies 


(1.3.10) 


k uv4T 

F(u  ) = — + — + o 

n n n 


n 


iiicn  letting  T = y lr_  n , we  obtain  from  the  above  lemma  and 
the  trivial  relation  <1(0)  = 1 - ^(-u). 


P(T  > k ) >•  'flu), 
n n' 


It  is  also  possible  to  formulate  the  exceedance  problem  for  cen- 
tral rank  sequences  k^^  , which  will  not  be  of  primary  interest  to  us 


31 


but  which  we  will  later  have  occasion  to  deal  with  to  some  extent. 
Again  let  u be  a real  number  and  let  be  a central  rank  sequence 

with  luiiiting  relative  rank  X,  0 < A < 1.  Suppose  the  level  u 


satisfies 


(1.3.11)  1 - F(u  ) = — - + o 

" /fi 


J. 


;ind  let  W = ^ >u  1 ’ using  the  more  general  form  of  Lemma 

' i=l  ^^i  n-* 

1.3.1  given  by  Leadbetter  (1977),  wc  have  that 


P(W  < k ) ^ $(u) 
Ml  n'^ 


Let  us  now  return  to  the  problem  of  limiting  distributions  of 
increasing  rank  order  statistics.  We  will  mainly  deal  with  tlie  asympto- 
tic theory  for  the  intermediate  ranks  case,  but  for  completeness  we 

first  briefly  consider  that  for  central  rank  terms.  Under  the  assuiip- 
rk_ 


tion  that  /n 


-A  ->-t,  0<A<1,  -oo<t<“>,  Smirnov  (1952) 


showed  that  any  limit  law  for  (normalized)  must  be  of  one  of  the 

*^n 

following  four  t>Ties: 

( 0 


Gj(x)  = 


C,(x)  = 


l-(c.x“) 


<H-C  |xl“) 


X < 0 
X > 0 

X < 0 
X ■ 0 


(c>0,  aXl) 


(c>0,  a>0) 


(1.3.12) 


C^lx)  = i 


‘!>f-Cj  |x|“)  , X < 0 


'Ifc^x'^^) 


n,(x)  = 


(c^X),  c,  ■(),  a>0) 


X > 0 

X < -1 
-1  V X < 1 
X > 1 . 


J 


r 
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Moreover,  Sminiov  found  necessary’  and  sufficient  conditions  completely 
specifying  the  domain  of  attraction  of  each  of  these  laws.  Other 


- X 


tends  to  -*>"  oi-  is 


results  arc  valid  when  the  quantity 
boimded  but  without  Ihnit  have  been  obtained  by  IVu  (1966).  Here  we 
only  provide  a well-known  particular  example  of  attraction  for  central 
order  statistics,  giv^en  by  the  following  result,  which  Cheng  (1965)  has 
proven  by  using  the  equivalence  of  (1.3.1a)  and  (1.3.1b):  Ihr  a d.f. 

F-,  if  there  is  a number  such  that  F(x^)  = A,  0 < A < I,  and 

inside  an  interval  ^ derivative  P which  is 

continuous  at  , and  f'(x-)^)  ^ 0.  then  [•  belongs  to  the  domain  of 
attraction  of  the  standard  normal  law  0 for  any  rank  sequence  k 


k 


sucli  tliat 


(1.3.13) 


> A;  specifically. 


P 


,d">  ■ b 
' n i 

a 


s X 


‘Hx) 


for  all  real  x;  where  a^^,  b^^  are  given  by 


P(b  ) = - 
^ n^  n 


(1.3.14)  and 


A~ 


"n  " nPTFT  • 

'■  ti 


Under  the  additional  assumption  that  emj)loying  an 

appropriate  change  in  the  noniializing  constants,  according  to  the  usu.il 
criteria  (see  Feller  (1966,  p.  246)  ),  we  find  tli.it  ( 1 . 3. 1 3)  - ( 1 . 3.  1 4 ) 
ticcomes  the  statement  that  - x^)  is  asymptotically  nomal  with 

mc.in  cero  and  variance  A(  1 -A)  [P  (x^)  ] , where  x^  is  the  imique  A- 

quantile  of  F.  Ihis  result  has  been  given  by  a number  of  authors. 


including,  for  ex.ample,  IVilk.s  (1962,  p.  273), 


7>7> 


Results  answering  the  question  of  the  possible  limit  laws  and 
their  doiiuiins  of  attraction  for  intermediate  order  statistics  of  i.i.d. 
sequences  have  been  obtained  by  Chibisov  (1964),  Cheng  (1965J,  and  IVu 
(1966).  Chibisov  Iws  shoun  that  for  a particular  class  of  rank  se- 
quences satisfying 


(1.3.15) 


n' 


where  H > 0 and  0 < 0 < 1,  the  possible  limit  laws  of  sequences 

r(n)  . 

arc  given  by 


^^(x)  =1 

l» 

1 

, X < 

0 

(a  > 0) 

i 4>(a 

log  x)  , X > 

0 

f <}>(-;: 

1 log  x)  , x < 

0 

,{x)  = 1 

1 

1 

(a  > 0) 

i 1 

, X > 

0 

C,(x)  = il>(x) 


-oo  < X < 


We  note  that  each  of  these  limit  laws  is  continuous,  so  tluit  (1.5.1a) 
would  necessarily  hold  for  all  real  x.  Moreover,  as  is  evident  upon 
replacing  C(x)  by  1 - G(-x),  for  the  same  class  of  intemediate  rank 
sequences,  tlicse  arc  also  the  possible  limit  laivs  for  largest 

terms  , . nic  following  theorem  of  Wu  (1966)  extends  these 

results  to  more  general  intcniicdiate  rank  sequences,  subject  only  to  a 
relatively  mild  restriction  (which  in  fact  can  be  weakened). 


Theorem  1.5.2.  Suppose  is  i.i.d.  and  let  k^  be  a monotonically 

increasing  (not  necessarily  strictly)  inteniicdiate  rank  sequence.  If 

there  arc  constants  a > 0,  b such  that 

n ’ n 


4"’  ■ ^ 

n 


n 


► d.  f . Ci(x) 


34 


for  all  continuity  points  x of  G,  then  G is  of  one  of  tlie  three 
tyi^es  listed  in  (1.3.16). 

Tor  the  intermediate  rank  sequences  he  considered,  Chibisov  (1964) 
found  necessary  ;md  sufficient  conditions  characterizing  the  domains  of 
attraction  of  each  of  the  limit  laws  (1.3.16).  As  in  the  fixed  ranks 
case,  membership  of  a distribution  in  a domain  of  attraction  for  snuill- 
est  terms  is  detcnnined  by  its  behavior  near  its  left  endpoint.  How- 
ever, the  domains  of  attraction  are  highly  dependent  upon  the  particu- 
lar rank  secpience  cliosen,  even  to  the  extent  that  for  each  of  the  laws 
Gj  and  G,  in  (1.3.16),  there  is  no  distribution  attracted  mider  each 
of  two  rank  sequences  satisfying  (1.3.15)  for  different  pairs  (0,K). 

In  addition,  tliere  are  rank  sequences  not  satisfying  (1.3.15)  for  which 
only  tlie  noniial  law  G,  = 4>  is  possible  (cf.  Ku  (1966,  p.  757)  ). 

I'hus  at  present  there  are  no  general  characterizations,  valid  for  all 
intermediate  rank  sequences  k^  , of  the  domains  of  attraction  of  the 
possible  limit  laws. 

However,  several  particular  results  dealing  with  domains  of  attrac- 
tion are  known  and  cover  many  situations  of  interest.  The  following 
two  theorems  due  to  Cheng  (1965)  show  that  tlie  normal  law  has  a nonvoid 
doiiuiin  of  attraction  for  every  intermediate  r;mk  sequence,  and  more- 
over, there  are  distributions  attracted  to  the  nonnal  law  for  every 
intermediate  rank  sequence.  The  first  of  these  is  funckimental  to  the 
results  we  will  develop  in  Gliapter  IV. 

I'heorem  1.3.3.  Let  be  ;in  i.i.d.  sequence  with  marginal  d.f.  f. 
Suppose  that  i-  has  a finite  left  endpoint  x^  such  that  l (x^)  = 0 
(tl'.at  is,  there  is  no  probability  mass  at  x^^  ),  ,'ind  in  ;m  interval 


(Xjj,  Xq+6),  the  derivative  F'  exists  and  is  positive,  and  such  that 
1 im  F'(x)  ■■  0.  Tl\cn  for  each  intermediate  rank  sequence  k , we  have 


’k  n 
n 


< X 


$(x) 


as  n -►  °o,  for  all  real  x,  where  ^ (depending  on  k^  ) are 

given  by 


F(b  ) = — , 
n n ’ 


(1.5.17)  aiul 


a = 


n 


n nF'(b  ) 
n 


.Mote  that  under  the  implicit  assiniiption  that  c = lim  F'(x)  exists, 

X+Xq 

we  nuiy  replace  a^  by 


(1.5.18) 


/r 

_n 

hi  nc 


a ' = 


Iheorem  1.5.1.  Suppose  is  i.i.d.  with  marginal  d.f.  F.  Let 

M > 0,  p < 1,  and  d be  given  real  numbers.  If  in  an  interval 
(-“>,d)  F is  twice  differentiable  ;md  such  tliat  in  this  interval, 
F'(x)  > 0, 


F(x) 
x^^F'  (x) 


M, 


and 


F(x)F"(x+o(x^)] 

[F’(x)]^’~' 


M, 


then  for  each  intennediate  rank  sequence  k^  , 


4"’-^n 


< X 


'Kx) 


as  n for  a 1 1 real 


X,  where 


r 


.^6 


F(b  ')  = — 
n n 


and 


/r 

n 


n nF' ' (b^) 

As  an  exajiiple,  Cheng  shows  that  the  standard  nonnal  distribution  <!• 
satisfies  tFie  conditions  of  'riieorem  1.3.4. 

These  results  can  of  course  be  rephrased  to  give  sufficient  con- 
ditions involving  a corresponding  behavior  of  the  marginal  d.f.  !• 
near  its  finite  or  infinite  right  endpoint,  for  the  sequence 
of  largest  rank  terms  to  hav^e  a limiting  nonnal  distribution,  that  is. 


, d"'  -b 

k ^ n 
n 


a 


< X 


n 


4>(x) 


for  all  real  x.  In  this  situation,  when  such  conditions  are  satisfied, 
the  appropriate  normalizing  constants  are  given  by 

k 

f(b  ) = 1 - — 

^ n n 


(1.3.19)  and 

^n  nP  (b  T 
n 

As  is  clear  from  symimetry,  the  noniuiJ  distribution  would  again  be  an 
ex;unple,  this  time  of  a distribution  attracted  to  itself  for  any  inter- 
mediate sequence  of  right  ranks. 

Finally  we  arc  led  to  consider  the  class  of  distributions  attract- 
ed to  the  noniuil  law  for  every  intermediate  rank  sequence,  lor  small- 
est terms  ^ Smirnov  (1967)  has  shown  that  this  class  consists  of 

all  distributions  F satisfying  the  following  condition:  lliere  exists 

a continuous  function  Q(z)  -*-0  as  z f x^  , such  that  for  all  real  x. 


j 


F 

z(l+xQ(z))| 

F 

2(J+Q(z)) 

. 4 

-F(z) 

whei'c  (i  -oo)  is  the  left  endpoint  of  F.  This  condition  is 
;malagous  to  Gnedenko's  (1943)  characterization  of  the  domain  of  attrac- 

_ -X 

tion  tor  maxima  ot  the  law  G~(x)  = e , in  that  some  suitable 
continuous  (unction  is  to  be  foiiiid.  However,  as  earlier  noted,  alter- 
native conditions  have  been  obtained  for  tliat  case,  and  it  would  be  of 
interest  to  see  if  other  conditions  could  as  well  be  found  for  the 
intermediate  case. 


CHAPTER  II 


LIMITING  DISTRIBUTIONS  OF  INTERMEDIATE  ORDER  STATISTICS 
FROM  STATIONARY  SEQUENCES 

2.1.  Preliminaries. 

In  this  chapter  we  study  the  problem  of  finding  sufficient  condi- 
tions luider  wliich  we  c:in  obtain  the  asymptotic  distributions  of  increas- 
ing rank  order  statistics  from  stationary,  dependent  sequences.  In 
particular  we  consider  the  situation  in  which,  for  a giv'en  de):>endent 
sequence  , and  increasing  rank  sequence  k^^  , the  r.v.  or 

(nonualized]  has  a limiting  distribution  which  is  the  s;imc  as 
n 

if  the  were  i.i.d.,  where  of  course  we  assume  that  the  marginal 
d.f,  of  fj  belongs  to  tlie  domain  of  attraction  of  a lunit  law  for  the 
sequence  of  nuiks  k^  . Ilie  conditions  we  impose  are  of  a tyi^e  similar 
to  those  wliich  we  hav^e  e.xamined  in  the  fi.xed  ranks  case,  one  signifi- 
cant difference  being  that  certain  rapid  ''mixing''  rates  are  assumed. 

As  we  might  expect,  the  procedures  used  in  dealing  with  the  same  prob- 
lem for  fixed  r^inks  are  most  readily  adapted  to  handle  the  as>miptotic 
distribution  problem  for  intennediate  order  statistics,  and  the  results 
we  establish  will  be  valid  only  for  this  case.  We  have  not  yet 
obtained  luialagous  results  for  central  ranks. 

Because  of  the  nature  of  our  conditions,  ;md  for  simplicity  in 
comparing  them  with  those  used  in  the  fixed  ranks  case,  especially 
Leadbetter's  flD74b,  1D77)  and  D'(Uj^),  we  will  develop  and 


.■^9 

initially  expiess  oui  results  for  largest  rather  than  smallest  nuik 
intennecliate  order  statistics.  Moreover,  in  our  procedures  we  will  in 
fact  deal  w'ith  the  more  general  problem  concerning  numbers  of  high 
level  exceed;inces  by  stationary,  dependent  sequences,  as  outlined  for 
i.i.d.  sequences  in  the  previous  chapter.  Tins  problem  is  interesting 
in  its  own  right  ;md,  of  course,  is  intimately  related  to  that  of 
limiting  distributions  of  order  statistics  of  largest  rank.  However, 
we  will  also  rephrase  our  conditions  and  results  as  they  would  pertain 
to  smallest  nmk  tenns. 

To  begin  the  development  let  us  suppose  that  is  a stationary 

sequence  of  r.v.'s  having  marginal  d.f.  F,  that  k^^  is  an  intermediate 


Let 


rxmk  sequence,  and  ^ is  the  h^-th  largest  of  ... 

n 

u be  a given  real  mmiber,  ;md  suppose  that  we  can  choose  a sequence  of 
levels  to  satisfy  (1.3.5),  that  is,  upon  relabeling. 


(2.1.11 


k uv'TT' 

1 - F (u  ) = — 2,  + o 

n n n 


According  to  (1.3.4)  this  can  certainly  be  done,  for  any  real  number  u, 

when  F belongs  to  the  domain  of  attraction  of  some  limit  law  G,  of 

one  of  the  types  listed  in  (1.3.141,  for  the  sequence  k^  . Now  let 

U be  the  mnnher  of  exceedcuices  of  u^  by  ...  , tliat  is, 

n 

K = y Ir^  n . (\ir  objective,  then,  is  to  establish  that  under 

n • If • n J 

1=1  ^1  n 

certain  de])cndence  conditions  we  have  tliat,  as  in  the  independent  case. 


(2.1.2)  F(W  < k j ->^  4>(uJ,  as  n “. 

■ n n 


he  h.ive  been  able  to  accomplish  that  by  means  of  each  of  two  some- 
what different  procedures.  In  Section  2.3  we  give  conditions  for 
general  intennediate  rank  sequences  under  which  the  desired  result 


I 


r 
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follows  unmediately  from  the  asymptotic  normality  of  a standardized 
form  of  , which  we  obtain  by  employing  known  central  limit  theory 
for  row  sunus  of  triangular  arrays  of  r.v. 's  dependent  in  each  row.  In 
the  next  section,  however,  we  give  a procedure  for  obtaining  (2.1.2)  by 
actually  approximating  the  value  of  P(W^  < k^)  by  alternative  quanti- 
ties which  can  be  more  easily  calculated;  the  nature  of  this  procedure, 
however,  is  such  that  it  is  apparently  successful  only  if  k^  does  not 
tend  to  infinity  too  rapidly,  in  a sense  which  we  make  precise  below. 

For  the  given  intennediate  rank  sequence  k^^  let  us  define 
0 = 0({k^})  by 

(2.1.3)  0 = inf{0^:  k^^  = 0(n  )}. 

Clearly  we  have  0 < 0 < 1,  and  it  will  be  convenient  to  regard  0 as 
a measure  of  how  rapidly  k^  tends  to  infinity.  Moreover,  regardless 
of  the  value  of  0,  it  is  evident  that  we  have 

(2.1.4)  k^  = o(n®^^),  for  every  e > 0. 

In  perhaps  the  most  typical  cases  we  actually  have  k^^  ~ cn®  for  some 
c > 0 and  0 < 0 < 1,  but  it  is  clearly  also  possible  to  have  0=0, 
indicating  a slowly  increasing  intermediate  rank  sequence,  as  for 
example  k^^  ~ c log  n,  or  0 = 1,  indicating  a rapidly  increasing 
intermediate  rank  sequence,  which  we  would  have  if,  for  exiuiriile, 
kj^  ~ cn(log  n)'^  . 

Our  basic  strategy  is  to  employ  a teclmique  used  in  various  fonns 
by  a number  of  previous  authors  when  dealing  with  dependent  r.v.'s 
satisfying  conditions  related  to  mixing,  including  its  original  use  in 
considering  central  limit  theory  (see,  for  example,  Hoeffding  and 


1^ 
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Robbins  (IIMS")  ).  Ive  first  let  and  be  sequences  of  positive 

integers  sucli  that 


(2.1.51  ->  Bj^  = o(n),  and  B^^  = o(a^). 

Tlien,  for  each  large  n ;in  integer  is  detennined  by  the  relation 


(2.1.6)  n = (a  + B U + R , 0 s R < a + 2B  ; 

^ ^ n n n n n n n ’ 


it  is  readily  checked  that 


(2.1.7) 


n -i 

I ~ na 
n n 


Ke  now  partition  the  first  n positive  integers  into  "intervals" 

...  >l7£^  )7£^  , of  respective  alternating  "lengths" 

“ n “ n 

a , B , a , B , . . . ,a  , R . Bv  inten'al  we  mean  a finite  set  of 
n’  n n n ’ n n 

consecutiv^c  integers,  and  the  length  of  any  inten'al  is  simply  the 
number  of  integers  it  contains.  For  any  set  of  integers  I,  which  may 
not  necessarily  be  an  interval,  we  let  U'j  = be  the  number  of 

exceedances  of  the  level  u^  by  (C^:  iel}.  (For  notational  simpli- 
city we  will  delete  explicit  dependence  upon  n .)  Tlien  we  may  \vrite 


W = y K r ^ ■ 
n jii  , n) 


■file  idea  now  is  to  show  that,  for  appropriate  choices  of  and  B^^  , 

the  r.v.'s  IV  with  i even  make  a negligible  contribution  as>tnpto- 

^ i 

tically,  in  determining  the  qruintity  P(1V^^  < k^)  or  the  limiting 
distribution  of  (stiindardizedj . Further,  we  can  deal  simultane- 

ously with  the  W . . , i odd,  without  too  much  difficulty,  under 


assumptions  analagous  to  those  of  the  fixed  ranks  case,  and  moreover 


42 


these  latter  r.v. 's  will  be  "approximately  independent"  for  largo  n. 

We  have  not  made  a significant  attempt  to  judge  the  relative  merits 
of  the  two  procedures  to  be  presented,  other  than  to  note  that  the  one 
given  in  Section  2.3  is  substantially  shorter.  One  obstacle  to  making 
comparisons  arises  from  having  to  assume  various  relationships  among  the 
sequences  6^^,  and  . Moreover,  in  Section  2.4  we  will  consider 

stationary  normal  sequences,  giving  covariance  conditions  sufficient  for 
obtaining  the  results  from  both  procedures,  and  we  will  see  that  in  tlvit 
case  the  relative  strengths  of  the  results  "overlap,"  one  admitting 
weaker  covariance  conditions  for  small  6 = 0({k^})  and  the  other  for 
large  6. 

We  now  consider  our  first  procedure,  involving  a direct  calcula- 
tion of  the  quantity  P(W^  < k^) . 

2.2.  Calculating  P(W^  < k^)  When  6 Is  "Small." 

We  continue  to  assume  that  is  stationary  with  marginal  d. f. 

F ;ind  k^  is  an  intermediate  rank  sequence.  We  will  however  in  this 
section  make  a restriction  upon  how  rapidly  1^  tends  to  infinity. 

For  the  given  sequence  let  s^  be  a sequence  of  positive 

integers  such  that 

(2.2.1)  s s = o(k^) . 

Ix't  as  now  suppose  that  and  are  sequences  of  positive  inte- 
gers satisfying  (2.1.5),  and  moreover  such  that 


(2.2.2) 


6 k 
n n 

■7 

a k“ 
n n 

8 k'^^ 
n n 


= o(n) , 
= o(a^). 


and 
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In  order  tliat  these  relationships,  which  will  be  crucial  in  the  develop- 
ment, be  satisfied,  it  is  necessary  to  assume  that  not  increase 
too  rapidly.  In  fact,  since 


k'  3 k fa  k“ 
n _ n n n n 


2^2 


n 


a s 
n n 


n 


3,k'"  s 
n n n 


n 


1 

1^  ^ 


^ - 0, 

b: 


n n 

we  see  that  we  are  restricting  our  consideration  to  rank  sequences  k 


2/S 

(or  which  k^^  = o(n  Moreover,  if  0 < 6 = 6({k^})  < 


h 


n 


5 ’ 


we  nuay 


actually  choose  ~ n^  and  3^^  ~ n^  for  some  0 < p < A < 1.  Then 

taking  s ~ n^  , 0 < v < ® , we  may  restate  (2.2.2)  as 

n 


U -t-  0 < A -t-  V, 


A + 20  < 1, 


(2.2.3) 


and 


P - A, 


which  is  in  fact  slightly  more  restrictive  than  (2.2.2).  Also,  if 


0 = 0,  wc  can  satisfy  (2.2.2)  by  taking  a ~ n''^  and  3 


for  anv 


clioices  of  A and  p such  that  0 < p < A < 1. 

N'ow,  for  a given  large  n,  let  i^^  = (i^,  ...  where 

ij^  < ...  < ij.  , be  a set  of  r integers  chosen  from  among  the  first 
8,^^  odd  positive  integers,  being  defined  by  (2.1.6),  and  where 


0 < r s k - s 
n n 


(IVe  define  i = A,  and  from  the  relations 

_o  ^ ’ 


a k = o(n)  and  I ~ na 
n n n n 

define  events 


-1 


we  may  assume  that  k < £ .)  We  then 

n n 


k -s 
n n 


A = 
n 


r=0 


n li  u fw  , , = in  n r n 

.■,11  k I i|")  Li'u 


— r 
i*  odd 


,W  . . = 0 

I I (n) 

'i' 
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and 


k -1 
n 


B = U U ^ I n 

r=k  -s  +1  all  i '■L-  i^i 
n n -r  -h* 


K(n)  ■')]"[  Kw  ■ »)]} 

1 -r  i' 


i'  odd 


Thus  the  event  contains  all  outcomes  for  which  in  each  of  up  to 

kj^  - s^  of  the  odd-indexed  intervals  •••  »^2£^-l 

n 

is  exactly  one  exceedance  of  the  level  u^  , given  by  (2.1.1),  by 

...  , and  in  the  remaining  odd-indexed  intervals  there  are  no 

e.xceedances ; a shnilar  statement  holds  for  the  event  B . We  show  by 
moans  of  the  following  lemmas  that  the  value  of  ^ can  be 

approximated  by  P(Aj^). 


Leninvi  2.2.1.  " P 


W A > s I 

i even  ^ 


s P(W  < k ) 
n n 


< P(A^)  + P(B^)  + P 


U W , , > 1, 

1 odd  l["*  > 


Proof:  The  second  equality  follows  from  the  set  relations 


(Wn  < k^)  L 


W 


U I) 


<-  A < k 

(n)  n 


W 


i odd 


U 

i odd  ^ 


,.  ..  < k - s 
(n)  n n 


f 


k - s < W , . < k 

n n I (n)  n 

i odd  * 


c A U B U 
- n n 


U W , , > 1 
i odd  I 

1 


Tlic  first  inequality  is  immediate,  since 


(Wn  < k^)  2 A^  n 


w 


U 


(n)  ^n 


1 even 
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i i 


U 1) 


, . > s n A 
(n)  n'  n 


even 


I.eiimvi  2.2.1.  it'  the  sequences  , nnd  s^^  are  sudi  that  (2.2.2) 


liolJs,  tlien 


U 


(n)  ■ ■'"n 


1 even 


0 , as  n 


l'roo£:  Usin<4  the  Markov  inequality  we  have 

F 


W 


U I 


fn)  " ‘n 


1 even 


< s'^  li  IV  , , 

n j(nl 

L 

1 even 


(i  +ns  + ci 


< _il n !1  . pr-  > u ) , 

1 n-^  ’ 


which  tends  to  zero,  since  from  (2.1.1)  we  have  P(^j  > u^)  ~ --  , .and 


since  Jl 

n n 


I.emma  2.2.5.  If  n J P(r,,>u  , d,  then 

^ M n’  ^1+j  n ’ 


pf  U (W 
^ i odd  1 


(n) 


1) 


0 , as  n 


Proof:  To  prove  this  we  note  that 


U (IV  , , > ll  I < £ P 
1 1 I (ti)  • J n 
1 Otld  I j ■' 


W,  , > 1 
,(n) 

1 


< I y p(f,->u  , c->u ) 

n , . ' M n 1 n’ 

l<i<j<cx^ 


a -1 
n 


s £ a y P(^T  m , . >u  } 

n n >1  ^1  n’  d+j  n^ 

j = l ■’ 


bv  stat  ion.ar  i tv,  .and  the  conclusion  follows,  since  £ a ~ n. 

' ’ ’ n n 
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On  combining  these  lemmas  we  obtain  the  following  result. 

Lemma  2.2.4.  If  the  sequences  , and  s^^  satisfy  the  relation - 

ships  (2.2.2),  and  if  n I P(5i>u  , 0,  then 

j.  ii  i'*-j  n 

|l>(Wn  < y - P(A^)|  < P(B^)  + 0(1), 


as  n 


Having  this  preliminary  result,  we  now  make  the  following 
assumption; 

Aji  For  the  given  sequence  of  levels  u^  satisfying  (2.1.1)  for  some 
real  number  u,  there  is  a system  of  sequences  (a^^,  B^^,  s^;  n>ll 
subject  to  (2.1.5),  (2.2.1),  and  (2.2.2),  and  such  that  the  following 


are  satisfied: 
(2.2.4) 
and 


n y P(^,>u  , Ci^->u  ) -> 
^^1  n’  ^1+j  n'^ 


0 as  n -*•  0°, 


Jl  ^ 


For  each  large  n,  for  p,q  > 1 and  integers  1 < i^  < . . . < i^  < 
...  < < n such  that  - i^  > £,  we  have 


iP^i  <u^,  ...  ,C-  <U^,  <U^,  ...  <u  ) 

i p -^1  -^q 



- • 

where 


• 5u  ) 1 
1 n-' ' 

■q 


(2.2.6) 


K. 

®n,B  " ^ n ->  CO, 


for  some  ic  > 1-X  > 0,  where  ~ n and  0 is  defined  by  (2.1.3) 
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We  see  that  (J.2.4)  is  sijiiply  the  hypothesis  of  Lemmas  2.2.3  ;mJ  2.2.4 
and  is  a vari;mt  of  the  condition  used  in  the  fixed  ranks 

case.  Also  we  note  that  (2. 2. 5)  - (2 . 2.bj  is  in  fact  the  condi- 

tion with  a certain  fast  rate  of  decrease  to  zero  by  ^ H will 
later  become  clear  why  we  assume  such  a rate,  there  being  in  tlie  in- 
creasing ranks  case  a need  to  consider  events  other  than  just  tliose 
relevant  to  fixed  ranks,  that  is,  of  the  fonn  appearing  in  (2.2.5). 

It  is  also  of  p.irticular  interest  here  to  see  e.xactly  how  the 
condition  (2.2.5)  relates  to  the  strong  mixing  condition  (1.2.16).  As 
is  apparent  (2.2.5)  will  be  satisfied  if  (1.2.16)  holds  witli  g(il)  1 0 
sufficiently  fast.  More  precisely,  sujipose  that  a system 

{'t  ,3  ,s  ; n 1 ) with  .x  ~ n'^  and  g ~ n^  is  chosen  subject  to 
n’  n n n n 

(2.1.5),  (2.2.1),  ;md  (2.2.2),  .and  tint  (2.2.4)  is  satisfied.  If 

(1.2.16)  holds,  then  clearly  so  does  (2.2.5)  with  ftj,  £ ~ 'i 

^1 

- i?  ^ 1 “ X 

in  addition,  g(f.)  = o(e  ) witli  Kj  > , then 

'^n,g  ” ^*^n^ 

n 

^1 

-6 

= o(e  'M 

K,U 

=o(e-‘'-^)”  ) 

for  some  ►.  > 0,  and  tlicn  (2.2.6)  will  hold  for  any  < such  that 
Kj-.j  > K > lA.  Our  condition  ( 2 . 2. 5)  - (2 . 2. 6)  is  ol  course  satisfied  by 
i.i.d.  sequences  , but  it  is  not  obvious  to  what  extent  we  arc 
restricting  the  class  of  stationary  sequences  being  considered.  How- 
ever, It  should  be  noted  that  this  "distributional  mixing"  is  poten- 
tially much  w('aker  than  strong  mixing  with  the  sequence  g(l’.)  tending 


to  zero  at  the  rate  indicated  above. 
We  now  present  the  main  result. 
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Theorem  2.2.5.  Let  ^ be  a stationary  sequence  of  r.v.'s  with  mar- 
ginal d.f.  F,  and  an  intermediate  rank  sequence  such  that 
2 

0 < 0 < -r  . Let  the  level  u be  defined  by  (2.1.1)  and  let 
n ^ n 


...  . If  the  assumption  holds,  then  POVj^  < 1^^^)  4’(u), 

as  n -*■  ». 

In  order  to  prove  this  theorem  we  will  show  that  under  Aj  , 
(2.2.7)  P(A^)  <t(u) 

and 


(2.2.8)  P(Bj^)  ->  0, 

as  n -►  ®.  llic  theoran  will  then  follow  by  Lemma  2.2.4.  Tliroughout, 
we  assume  that  a system  ^“n’^n’^n’  which  all  of  the  given 

conditions  are  satisfied  has  been  cliosen.  We  begin  with  the  following 
Icmiiuis. 


Lemma  2.2.6.  As  n -*■  <», 


n n 

I 

r=0 


W 

I 


(n) 

1 


ir  t— 


> 1 


W 


(n) 


-r 


4>(u). 


Again  note  that  k^  = o(L^)  by  (2.1.7)  and  (2.2.2),  so  that 
for  all  large  n. 


k 


n 


< £ 

n 


Proof : By  Lemma  1.3.1  it  suffices  to  show  that 


[2.2 


as  u ■*  I'o  obtain  this  we  first  note  that  for  any  nonncgativ'c 
integer-va ] ued  r.\'.  Z we  have  the  easily  proven  inequalities 


h Z < P(Z-l)  + [•;  Z(Z-l)  < P(Z>1)  + li  Z(Z-l).  ilien  writing  Z = IV 


^[^>u  ] 
j = l j n 


we  liave 


0 < F,  IV 


(n) 


IV  . , - 1 
, fn) 

‘l 


= I PfC:>U„,  ^.>U  J - y P(5.  -U  ) 
ij  = l » n’  ’J  n^  n' 

= y P(c->u  , ^.>u  ) 


i^J 


(2.2.10) 


< Z a y P(5,>u  , Ci^  -'U  ) 
n ^^1  n ^1+j  IV 


= o 


by  (2.2.4).  Hence 


0 < F IV  , s - P 
, (n) 


(n) 


> 1 < F IV 


(n) 


K'  , - 1 
, (n) 

‘l 


= o 


1 1 
e 


and  so 


(n) 


> 1 = F IV 


(n) 


- o 


(2.2.11) 


= % I’CSi  > u^)  - o 


a k uu 
n n n n 


+ o 


a /IT”' 

n n 


.\ow  since 


a "i  £ f a I ■ 

" = /iri  1 - -2J1 


ni-a  £ -3  £ 3 £ I 
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(a  +2S  )k 
< — D — 2 — 2 + 0 
n 


fe  AH 

' n n 


by  (2.2.2),  ajid  since  = o(k^) , we  have 


u„k 


k 

vin 

A -s 

n 

n n 

z ° 

Z 

Z 

n 

n J 

Hy  inserting  this  into  (2.2.11)  along  with  the  relation 
uAT  = u/^  (1  . o(D)  = ^ 

we  obtain  (2.2.9). 

Lerram  1.1. 1_. 

(I 


k -1 
n 


I 


r=k  -s  +1 
n n 


*^%(n) 

^1 


W . ^ = 0 
r(n) 

‘l 


'n- 


0,  as  n > 


Proof:  To  prove  this  we  will  use  tlie  Berry-Fisseen  bound  (v;ui  Beek 

(1972)):  If  Xj,  ...  ,X^  are  i.i.d.  r.v.'s  each  Iiaving  zero  mean, 

2 

variance  o , and  absolute  tliird  moment  p > 0,  then 


X +...+X 
1 n 


Of/n 


s X 


l>(x) 


o^^n 


unifonnly  for  all  real  x,  where  C < 1 is  an  absolute  constant. 

Si , Z, 


Now,  for  each  n let  2 ’ ‘ i.i.d.  Bernoulli 


r.v.'s  with  mean  p = P 


(n) 

1 


5 1 . 'Ilien  from  the  aliove  we  liave 


r 


SI 


k 1 
n 


r=k  -s  +1 
n n 


ck 


'V  , > 1 

I (n) 


(nj  = « 


«.  -r 
n 


- 1*- ••*><„, = 


-Vn 


I (t  p ( I -p 

^ '■  ir  n ' n 


k - l-£  p 
< II n*  n 


k - 1 - £ p 
n n‘  n 


[(VnO'f’n')' 


+ IP 


fX  , + . . , +X  ^ £ D 
n,l  n,£  n^n  k -s  -£  p 

< n n n'  n 


n 


£ 


- <!> 


f k -s  -£  p 
II  _ 111 

(£  p { 1-p 

^ n‘  n ‘ n 


+ ^ 


k -1 -£  p 
n IV  n 

_ A 

f k -s  -£  p 
n n IV  n 

(?  p ( I.-p  )1  - 
'■  IV  n ‘ n ' 

’(a„p„n-i)  )]'^ 
" Ml'  n 'll-' 

A'p 

T1 

" 'S/‘2  T7^ 


+ -f 


k - ] - £ p 
n n‘  n 


- 't 


k - s - £ p 
n t)  _nMi_ 


MriLc  ‘ ' I*  ■ I'n^  Pn  * Pil’  ' Pn*  ^ ^ P|i 

.some  const.ijit  K not  (Icpfiidiii^  on  n.  Now  since  p^  ‘ 0 ,-uul 

^J’n  ’ (‘-.1.9),  the  first  tenit  in  tiic  last  expression  altove  tends 


to  ’cro.  \ls(o,  since  £ p II  - p ) 

n‘  n I n 

retiuiins  to  show  that 


*^n  ■'^n  ~ only 


k 


r 
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(2.2.12) 


k -£  p 
n n*^n 


converges,  as  n But  it  follows  from  (2.2.9)  that 


k ui/ir" 

p„  • r ■ “ 

n n 


, so  that  clearly  we  have  k - fi,  p ~ u/lT”  , 
‘ n n*^n  n ’ 


and  again  since  «-j^Pj^(l  - Pj^)  ~ k^  , the  quantity  (2.2.12)  tends  to  the 


limit  u. 


In  the  next  result  we  show  that  P 


W (r.\  = 1 

r (n) 


Lemma  2.2.8. 

k -s 
n n 

(a)  \ 

r=0 


in  the  above. 


may  be  replaced  by 


(1  : 

f 

n 

P 

r 

1 

(n)  ^ 1 
1 


\ 

r 

( 

^’Kcn)  = 
1-  n 

I 

r=0 


(1 

' 

r 

■ 

n 

r 

P 

W . , = 1 
r(a) 

P 

r,(n)  ■ 
1 

— 

— 

— 

— 

0, 


as  n 


k -1 
n 

(b)  I 

r=k  -s  +1 
n n 


(1 

' 

r 

““ 

> 

n 

r 

P 

(n)  " \ 

P 

W , , = 0 

[ rW  J 

-J 

— 

— 

k -1 
n 


r=k  -s  +1 
n n 


■ 

r 

r '1 

n 

r 

P 

L.  ^1  _i 

— 

— 

- 0, 


as  n * “. 


Proof:  The  proofs  of  these  two  statements  are  virtually  identical , so 


we  only  consider  (a).  We  first  note  the  fact  that 


S.3 


G < P 


W , , > 1 
, (n) 


< 1:  W 

I 


(n) 


1 '1 


IV  , , - 1 
j (n) 


so  that  by  (2.2.10),  P(W  ^ Thus  we  have 


k -s  „ 
u n (Z 

I 

r=() 


'Vn)  ^ ^ 


W , , = 0 
r(n) 


rZ 

I 

r=0 


W , . = 1 
, (n) 

4 


1r 


IV  . . = 1) 
rCn) 

M 


— ,V  -r 
n 


K -s 
n n 

I 

r=0 


— ,r  r-- 


|IV  , ^ > 1 


— ilh  r- 


U'  , = 1 
, (n) 

^ 1 


W , = 0 

r(nj 


— I Z ~ T' 
i n 


n 

^ I 

r=0 


r^ 

— 

• 

— 

r 

— 

r 

— 

n 

r 

P 

iV  , . > 1 
I (n) 

P 

II 

o 

_ 

' 1 

— 

— 

Z 

n 

I 

r=0 


IV  , = 1 

1 (n) 

L-  *1 


r r— 


IV  . . = 0 

r(n) 


iSi'*' 


= 1 - 


I - I'Ov  > 1) 

' I 


= 1 


which  tends  to  zero. 


Before  developing  the  further  needed  notation  and  proving  the 
theorem,  wc  state  several  more  useful  lemmas  which  enable  us  to  extend 
our  consideration  from  events  of  the  form  appearing  in  the  condition 
(2.2.5),  that  is,  of  the  form  i c set  of  integers  1),  to 

other  events  relevant  to  the  exceedance  problem  under  our  present 


1 
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procedure . 

Lenima  2.2.9.  Given  an  integer  r > 1,  let  ...  ,B^  c be 

events . Then 

P[(A  \B,)n...n(A  \B J]  = \ (-1)^  I p/f  0 A.~|  n f f1  B.,~||, 

— S — b — s 

where  for  fixed  s,  0 ^ s ^ r,  the  inner  sum  is  taken  over  all  dis- 
tinct subsets  of  s integers  chosen  from  among  {1,  ...  ,r}.  OVe 

define  i = 4)  .) 

-o  ^ 

Proof:  It  is  trivial  that  for  r = 1 or  2 we  have  respectively, 

P(Aj\B^)  = P(Ap  - P(Bj) 
and 

P[(A^\Bp  n (A2\B2)]  = P(A^A2)  - l’(AjB2)  - P(A2B^  + P(B^B2). 

Then  assuming  that  the  result  holds  for  a given  r we  have,  induc- 
tively, 

P[(Aj\Bp  n ...  n (A^\BJ  n (A^^i\B^^t)] 


r r 


r+1 ' r+1' 


• ? i-n"  I n]]  " r,5i  *1']  ■ 

where  in  this  last  line  the  inner  sum  is  taken  over  subsets  ^ of 
n,  ...  ,r+ll.  'Hiis  establishes  the  lemma. 

Lenin, a 2.2.10.  Let  Aj  ,B, , . . . be  events  as  in  Lemma  2.2.9. 


P(A,\B^]  ...  l’(A 


,\iy  I (-iPi 


-s 


'roof;  This  is  easily  obtained  by  elementary  calculations,  which  will 


Proof:  Thi 

be  omitted. 


Lemnu  2.2.11.  fix  n (large)  and  let 

(n)  I (n) 

pin)  ,[n)  l-l^e  odd-indexed  intervals  1,  > •••  ’‘2.1.  -1 

21.  -1-  21.  -1  ’ 

as  defined  in  Section  2.1.  Now  define  events  Lb  b> 

I).  = v.jSLi^.  foi'  jcS ) . 


for  i = 

1 1 - 1 . 
‘"b  • • • ’“In 

Iben  (2.2.5)  implies 

21  -1 

1 C n ^ 

21  -1 
n 

(2.2.13) 

B n Dj  - 

1 i=l 

n 1'1‘V  " S “"•1 

i=l 

i odd 

i odd 

Proof; 

hor  odd  integers 

i i l<i,<iT- 

1],  ^2’  1 2 

iPdij  D;  ) - M’lUj  )1  s 

1^  ^2  12  n 
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by  (2.2.5).  Now  let  1 < < ...  < ^ - 1 be  odd  integers. 

If  for  r < 2 we  have 

(2.2.14)  |P(  fi  D ) - n P(D  )|  < (r-l)g  , 

s=l  s=l 

r 

then  since  for  any  r the  event  f|  D.  is  also  of  the  form  suitable 

s=l  ^s 

for  applying  (2.2.5)  we  have 

|I^(V  D.  ) - V P(D  )|  < |P('^n^  D ) - P(  n D )P(D  )| 
s=l  s s=l  s s=l  s s=l  ^s  ^r+1 


^ ^(Di  )|P(  n D ) - n P(D  )| 
r+l  s=l  ^s  s=l  ^s 


Thus  by  induction  (2.2.14)  holds  for  2 < r < and  in  particular  for 
r = , which  gives  (2.2.13). 


Combining  the  previous  three  lemmas  and  using  the  elementary  facts 

r r r 

that  ^ ( ) = 2 and  the  absolute  value  of  a sum  does  not  exceed  the 

s=0 

sum  of  the  absolute  values,  we  obtain  the  following  result. 


Lcinna  2.2.12.  Pix  n (large)  and  an  odd  integer  r such  that 
1 < r < 2£  - 1.  Suppose  that  events  A- , B.  , with  B.  c A.  , 
i = 1,3,  ...  ,r,  and  , i = r+2,  r+4,  ...  ,2£^  - 1,  are  all  of  the 
siime  form  as  the  events  described  in  Lemma  2.2.11,  that  is,  of  the 
form  (Cj  ^ iijj,  for  j belonging  to  some  c Tlicn 
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2.^-1 


|P[(Aj\B^',  n ...  n fl  C ] 

I i=r+2 


i odd 


P(A,\Bp  ...  P(A^\B^,)P(C^^2^  ...  PfC^,  .j) 

n 


< 2^  i e 

n • 

We  now  establish  some  further  notation  needed  in  the  proof  of  the 
theorem,  fix  n (large)  and  for  each  odd  integer  i,  1 < i •'  2£^^  - 1, 


define  events  as  follows: 


h]  = {C->u^.  k.i,  j . l[">  , 

f’  = {f, .^u  , for  all  = W , = 0 , 

1 n’  1 i j(i)  J ’ 


I'j  = ‘ill  1^  e l["K{j 


Iliat  is, 


is  the  event  that  there  is  .an  exceedance  of  at 


"time”  j in  the  interval  I j and  there  are  no  other  e.xceed;inccs 

in  , F*  is  the  event  that  there  are  no  e.xceedances  in  1^^^  , 

and  pi  is  the  event  that  there  are  no  exceedances  in  1^^^  c.xcept 
J 1 

possibly  at  time  j.  (We  have  deleted  dependence  upon  n.)  It  is 
clear  that  the  following  relationships  hold: 


,1  ,.i  ^1 

l:j  u I.  . F.  , 

f j \ r'  . e:  , 


L'l  I't 
F c {• . 


for  each  j c 1^^  ;ind  each  i = 1,  3, 


,2£  - 1.  With  this  nota- 

’ n 


tion  ;md  the  preceding  lemimas  we  now  prove  the  theorem. 
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Proof  of  nieorem  2.2.5:  Fix  n large.  We  note  tliat  for  each 

i = 1,  3.  ...  - 1, 


so  that  the  event  |w  =1  is  a disjoint  union  of  subevents 

each  of  which  is  a proper  difference  of  two  events,  both  of  the  form 
1).  given  in  Leinnvi  2.2.11. 

Now,  for  0 < r < let  i_^  = ...  ,i^}  be  a choice  of  r 

odd  integers  from  {1,  3,  ...  ,21^  - 1).  Then 


i'  odd 


n 


i'  odd 


Also,  by  stationarity  it  may  be  easily  seen  that 


i'  odd 
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j.  crl”’ 


).  cl^"' 
• 1 1 
r r 


f/  \ F ■‘i 

...  p 

i i 

F.^  \ F 

11  P(l''’) 

1 

J 

i'ii,. 
i ' odd 

Noting  that  we  now  have  events  of  the  fonii  suitable  for  ap]ilying  the 
ilevelopiiK'nt  in  Leimiris  2.2.8-2.2.12  we  see  tlvit 


l‘1  ."i  " i'a,, 

V L_  _1-  I -1  1 

i'  odd 


I’  IV  . 1 P W , , ■ 0 


" ‘n  S„,e^  ■ 

by  bemina  2.2.12.  I'lien,  suinming  over  all  possible  distinct  combinations 

i and  all  r 0 < r s k - s , and  recalling  tlte  definition  of  tlie 
-r  n n 

event  , we  have 


k s „ 
n n r*!-.. 


!'’*v  • ,L  r -‘I  “ 


^n  ^n  fH  -1 

y (2a  ) £ g„  o 


2'"  (2aj''^  g^^, 


< ^n  «n,6. 


= expilog  P,|_^  + £j^(log  4 + log  a^U 


< c e 
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for  all  Kj  > 1 - X > 0,  when  n is  sufficiently  large.  Taking 
Kj  > K we  have  this  last  expression  tending  to  zero,  by  (2.2.6). 
Combining  this  with  Lemmas  2.2.6  and  2.2.8(a)  we  see  that  P(^jj)  ‘l’(u) 
as  n ->  »,  that  is,  (2.2.7)  holds. 

To  show  (2.2.8)  we  first  observe  that 

P(B^)  = P 


r^ 

i ' odd 


k - s„  < W < 

n n 2£  -1  ^ 

i=l  ^ 
i odd 


2SL  -1 
n 

n 

i=l 
i odd 


W , . < 1 

I 

i 


k -1  , 

I I P 

=k  -s_+l  i^ 


(n) 


= 1 


n 

i'U. 


r,(n)  ■ “J 


and  so,  repeating  the  same  steps  above,  we  obtain 


k -1  . 

n 

P(B„)  - I 

" r=k  -s  +1 
n n 


n“,(n)  • ' 

L-  n 


fw  , , = o| 

I n)  J 


-V* 


k -1 
n 

I I H 

'■■'‘n-V'  ir 


' — 

— 

— 

n 

W'  . = 1 
1 I (n)  J 

i 

n 

n 

Li 'Ur 

W , , = 0 
j(n) 

M’ 

i ' odd 


k -1 
n 


I 1 


' — 

— 

— 

• 

— 

'j 

n p 

iLiUr 

il(n)  \ 

i 

n p 

Li’^i,- 

W , , = 0 
[ j(n)  J 

i' 

J 

i ' odd 


k -1 
n 

1 

r=k  -s  +1 
n n 


^,3.. 


" ^,6. 


for  all  K > Kj  > 1 - X.  Tills  along  with  Lemmas  2.2.7  and  2.2.8(b) 
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giv'-es  (2.2.8),  which  completes  the  proof  of  the  theorem. 

Reiiuirk  1.  In  the  above  development  we  did  not  use  fully  the  rostric- 
tion  a k*"  = o(n)  made  in  (2.2.2),  but  onlv  tliat  a k = o(n).  Kith 
Just  this  latter  it  tunis  out  that  we  can  c.xtcnd  consideration  to  inter- 
mediate  rank  sequences  k for  which  0 < ^ . Howcv'^er,  for  indcpen- 

k 

dent  sequences  it  is  easily  seen  from  the  relation  P(fj  > u^)  ~ — 

that  the  stronger  restriction  = o(n)  is  necessary  for  (2.2.4), 

so  that  for  an  extension  our  conditions  would  actually  require  some 
degree  of  departure  from  independence.  Moreover,  in  the  important 
normal  case  to  he  dealt  with  in  Section  2.4,  it  is  appropriate  to  con- 
sider sequences  which  arc  at  least  "approximately  independent,"  and  we 
will  find  it  coiwenient  there  to  use  the  stronger  restriction. 

Remark  2.  In  the  particular  case  where  0=0  it  is  possible  to  weaken 

somewhat  the  exponential  "mixing"  rate  required  in  (2.2.6),  provided 

A 

that  (2.2.4)  holds  for  some  a for  which  — >•  0 for  even’  A < 1 

n 

(or  more  simply,  if  (2.2.4)  holds  with  replaced  by  n as  the 
upper  limit  of  sunmuition,  a condition  vvhich  would  necessarily  exclude 
independent  setiucnces  from  consideration).  To  indicate  this,  for  a 
given  stationary  sequence  and  intennediate  raiik  sequence  k^^  for 


which  0 = 0,  clioose  0 < Cj  < 'i  and  c,  > 1 and  let 


r 
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so  that  the  relationships  (2,2,2)  are  satisfied.  Also,  suppose  that 
(2,2,4)  is  satisfied  with  this  choice  of  , Then,  if  (2,2,5)  holds 
with 


(2,2,17) 


= 0 


= 0 


l+e,+e^ 

^ log  o'! 


then  we  can  see  from  (2,2,15)  that  the  conclusion  of  our  theorem  re- 
mains valid. 

As  an  immediate  corollary  of  the  theorem  we  can  obtain  a result 
giving  the  asymptotic  distribution  of  the  largest  order  statistic 

the  stationary  sequence  , 

'llieorem  2,2,13,  Suppose  the  marginal  d,f,  of  belongs  to  the 
domain  of  attraction  of  the  limit  law  G for  the  intermediate  rank 
sequence  k^^  ; that  is,  for  some  constants  ^ we  have 

P(n) 


- b 


< X 


n 


G(x)  = <I>(u(x)) 


Ti 

If  Aj  is  satisfied  for  u^^  = a^x  + b^^  with 


as  n for  all  real  x,  where  is  the  independent  sequence 

associated  with 

u = u(x)  for  all  real  x for  which  u(x)  is  finite,  or  equivalently, 
for  which  0 < G(x)  < 1,  then  also 

f/"’  - b. 


(2,2,18) 


n 


n 


s X 


n 


G(x) 


for  all  real  x. 


()7, 


Proof:  I'or  \ such  that  U < G(x)  < 1 we  have  the  fundamental  rela- 

. r('i)  K 


t ion 


k 

IJ 

n 

n 

a 

n 

X 


- i'OV„  < , 


»hcre  l(  . I l[  ] and  » a x • 1,„  . Since 
j = 1 1 n 


k u x) 

1 re  \ II  II  j. 

- '(U  ) = — + 0 

n n n 


l>y  (,1.3.4),  the  conclusion  (2.2.18)  for  such  x follows  froin  'nieorem 
2.2.5.  Now  suppose  x is  such  that  G(xj  = 0.  Since  G is  continu- 
ous, given  an  arbitrary  c > 0,  we  c:m  find  an  x^  > .x  such  that 

0 < G(x  ) < c.  llnus 
e 


lim  P 
n 


- b 

k ^ n 

-II < X 

"n 


so  that 


ILm  P 
n 


< lim  P 
n 


= fifx^J 


< 0, 


, c(")  - 1, 

k n 

n , ^ 

a 

n 


, c'-’i  - s 

n 


n 


s X 


n 


= 0 = G(x). 


Similarly  we  may  consider  x such  that  G(xJ  - 1,  and  the  jiroof  is 
complete. 

We  conclude  this  section  by  restating  the  assumption  and 

Iheorem  2.2.13  for  consideration  of  sequences  of  smallest  rank  teniis 

r(n) 


AJ  ; I'or  the  given  sequence  u^^  satisfying 


k 
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k u»^ 

F(u  ) = ^ + ^ + o 

^ iv^  n n 


for  some  real  number  u,  there  is  a system  of  sequences 

s^;  nil}  subject  to  (2.1.5),  (2.2.1),  and  (2.2.2),  and  such 
that  the  following  are  satisfied; 

“n'l 

n I -*0  as  n 

j=l  J 

and 


For  each  large  n,  for  integers  p,q  < and  integers 

l<i,<...<i  <Ji<...<j  ^n  such  that  j , - i > 2, , we  have 

1 p -^1  -^q  -^1  p 

I P (C - >u  , ...  , 5 . >u  , ^ . >u  , ...  >u  ] 

' ^ \ n’  ''-1^  n’  n’  n^ 

- pf^.  >u  , ...  ,C-  >u  )pf^.  >u  , , 
n’  ’^1  n-'  '•^3j  n’ 


■ >'>  ) 1 
j n'  ' 


^ g 


where 


^n,6,. 


n,2  ’ 


= o(e  ) as  n 


for  some  k > 1 - A > 0,  where  ~ n ;uid  0 is  defined  by  (2.1.3). 

Tlieorem  2.2.14.  Suppose  the  marginal  d.f.  of  the  stationary  sequence 

belongs  to  the  domain  of  attraction  of  the  limit  law  G for  the 

given  intermediate  rank  sequence  k^^  , for  smallest  terms;  that  is,  for 

some  a > 0,  b we  have 
n ’ n 


n 


s X 


G(x)  = 4>(u(x)) 


as  n for  all  real  x.  If  A,'  is  satisfied  for  u = a x + b 

1 n n n 


()5 


with  u = u(x)  for  all  real  x for  which  u(x)  is  finite,  or  C([ui- 
valently,  for  which  0 < G(x)  < 1,  then  also 


(n) 

k 

n 


- b 


< X 


- G(x) 


for  all  real  x. 


2^. A Second  Procedure  Using  Central  Limit  Theory. 


In  tl\i^  section  we  present  an  alteniative  method  for  cstabl  ishinj^ 
(.2.1.2)  using  the  fr;imework  in  Section  2.1,  and  in  which  tlierc  is  no 
general  restriction  as  to  how  rapidly  the  intennediate  nmk  sequence 
kj^  tends  to  infinity.  The  assumption  we  will  make  is  of  a similar 
ty^ic,  yet  still  somewhat  different  from,  tlic  assiunption  Aj  of  the 
last  section,  with  one  importajit  difference  being  that  the  relation- 
ships (2.2.2),  which  restricted  what  intermediate  rank  sequences  could 
be  considered,  will  be  replaced.  .'\s  we  liave  previously  mentioned,  the 
essence  of  the  procedure  will  be  to  establish  the  asymptotic  nonnality 
of  a standardised  fom  of  tiie  r.v.  U in  such  a way  as  to  lead  imme- 
d lately  to  the  desired  conclusion  (2.1.2). 

As  in  Section  2.1  we  continue  to  suppose  that  is  a given 

stationary  sequence  with  imarginal  d.f.  I-,  is  a sequence  of  inter- 

mediate ranks,  the  level  u^^  is  chosen  to  satisfy  (2.1.1)  for  some 

n 


real  number  u,  and  W = ^ >u  1 

i = l ^^i  IV* 

t ion  to  be  used  in  this  section. 


llio  following  is  tlw  assimip- 


A,:  There  is  a system  la^^,  n>l)  subject  to  (2.1.5)  and  sucli 


that 


(2.3.1) 


and 


()6 


a = o(i/F^ 
n n 


and  for  which  the  following  hold: 


(2.3.2)  - (1  - l.(u„))^l  . o(^ 

as  n ->•  “o,  and 


(2.3.3) 

where 


n n 

— g 0 as  n 

a '’n 
n 


’ = sup  sup  ll’(Al^)  - I’(A)l’(h)|, 

‘ l<in<2«.  -1  Ac^ 

n <^n,i 


,m 

M.,n.2 


^n,m  o-field  generated  by  W , ...  „+2 


. . ,W 


, and 


the  a-field  generated  by  W 

I 


(n)  ’ 
m+2 


. ,W 


(n)  • 
'21 


We  note  that  the  intervals  and  1 arc  ''separated''  by  at 

m m+2  ' ^ 

least  3^  . It  is  then  evident  that  a condition  sufficient  for  (2.3.3), 
which  is  stronger  in  that  more  events  must  be  considered,  is 


(2.3.4)  — h (B  ) 0 as  n ‘ <•■, 

a n n 
n 

whe  re 


It„(£) 


sup  su]")  |l’(Ab)  - l’(A)l’(H)l, 

K.mn.l 


and 


^n,n  being  the  a- field  generated  by  • rr  . V 1 


<^n,m.£+l  the  o- fie  Id  generated  by  1^  „ ,.u  ] ’ 

‘-"m+£+l  ir' 


••  ’'[f  Ml  ] • 

n n 

for  fixed  n,  m let  j_  be  a subset  of  the  first  m integers  and 


a subset  of  tlie  integers  from  m + 3^^  + 1 to  n.  Define  events 

A.  = , it  i ; f,-,su  , i {1 , . . . ,m}\i  > 

j_  (in  - 1 !i  -j 


(2.3.5)  and 


Then  we  can  see  that  each  A ^ can  be  written  as  some  disjoint 

”n,m 


luiion  of  at  most 


VTI 


events  eacii  of  the  fonii  A.  , and  similarly  each 


q,  — n-m-3^^ 

event  B tov'  is  some  disjoint  union  of  at  most  2 ’ 

n,m+B^+l 

events  of  the  form  . Hence  a sufficient  condition  for  (2.3.4)  is 


(2.3.6) 
wile  re 


f — - h' 

a 11 
n 


0, 


li’  = su]i  sup  il>(A.B.)  - l'(A.  )P(B. ) I . 
lMn*n-6  i ,j  ^ 

t)ne  can  show,  as  we  did  for  the  condition  A^  in  the  last  sec- 
tion, tliat  (2.3.6)  is  satisfied  by  strongly  mixing  sequences  in  which 
g(£)  1 0 at  some  particular  e.xixment ial  rate,  but  that  (2.3.6)  is 
potentially  much  wealver.  However,  the  condition  (2.3.3)  is  substan- 
tially weaker  yet,  there  being  fewer  events  to  lie  considered,  and 
appaiently  an  exponential  rate  of  convergence  in  (2.3.3)  is  not  re- 
(|uired.  Unfortunately,  in  some  instances  (2.3.3)  may  be  hard  to  verify, 
due  to  the  nature  of  tlie  events  involved,  and  as  an  example,  we  have 
found  this  to  be  the  case  for  stationary’  nonnal  sequences  considered  in 
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the  next  section,  where  with  the  presently  known  results  dealing  with 
nonual  sequences  we  will  necessarily  be  content  to  work  with  (2.3.6). 

In  this  section  on  general  stationary  sequences  we  will  use  assuitp- 
tion  as  stated,  however,  and  we  now  suppose,  for  the  given  se- 
quence , that  sequences  of  integers  ;md  have  been  chosen 

for  which  all  of  the  restrictions  ^md  conditions  are  satisfied.  Having 
this,  we  then  define  a triangular  array  of  r.v.'s  {X  •},  n large 

ami  1 < i ' 28,  , by 

n ’ ^ 


where 


(n) 


- fi  W 

I 


(n) 


n,i 


o 

n n 


7 

o“ 

n 


= Var  W 

[ 


(n) 

I 


(2.3.7) 


= n r(u  ) (l  - F(u  )1 
n ^ n n 

an'l 


Tlie  key  to  our  approach  is  the  following  result  of  I)voretzk>'  (1972, 
Ilieorem  5.1),  a central  limit  theorem  for  triangular  arrays  with  depen- 
dent r.v. 's  in  each  row,  and  which  extends  the  classical  theorem  for 
arrays  with  independence  within  rows  (see,  for  example,  Lodvc  (1963,  p. 
295)  ).  We  state  this  result  as  a lemma  and  in  original  fonn,  which  is 
more  general  than  what  we  require. 


bemnia  2.3.1. 


i;  X . = 0 

n,  I 


bet  ■ ^n,  i ^n7l , 1 <isN^  Kx> 
for  all  n,  i,  and  let 


be  an  array  of  r.v.'s  with 


g (k)  --  svip  siqi 

1<iinN  -k 

II  'll, Ml 


siqi  \?(.m  - 1>(A1!’(B)1, 


whore  Is  the  o- field  generated  by  j,  ...  ^nd 

^i,m+kM  is  the  o-field  generated  by  . . . . 


there  are  integers 


0 = j„(0)  < j„(i)  < ...  < 


sucli  that,  defining 


j„U') 

'".i ' x,i ' 


we  have 


i = 1 , 


lim  I i;  V"  = 1, 
n i odd 


lim  I i;  Y“  . = 0, 
n i even 


r 

,C  '[|V„.,l>c]) 


n for  all  c > 0. 


Ilien  lim  r g (k  ) = 0,  where  k = min  - j (r-ll),  im|ilies 

that 


i=l 


1 > denotes  eonvcrgcncc  in  distribution. 

21 


II  ^ 

Now  W = y IV,,,  and  as  tlie  following  lemma  shows,  I X • is 
n >1  I in)  l = , ii.i 

the  a[)propr iate  standardization  oi  , under  the  assumption  A^  . 

lliis  result  will  therefore  constitute  the  major  portion  of  sliowing  tliat 


1 


implies  (,2.1.2). 


Lemma  2.3.2.  Under  A 


1 1 

2 , [ ^ is  asymptotically  normal  (0,1), 


Proof:  Clearly  li  X . = 0 for  all  n,i  . If  we  can  establish  that 

n,i 


(2.3.8) 


lim  I E X"^  . = 1, 
■ 1 1 n,i  ’ 

n 1 odd  ’ 


(2.3.9) 


lim  y E X^  . = 0, 
n 1 ^ 

n 1 even  ’ 


(2.3.10)  Urn  y EX  ,,^3 

n 1=1  ' n,j' 


= 0 for  every  e > 0, 


then  along  with  (2.3.3)  we  will  have  fulfilled  the  conditions  of  Lenma 

2.3.1,  and  the  conclusion  will  follow.  Here  we  are  taking  ~ ’^n  ~ 

21  and  i(r)=r,  0<r<2£  , for  each  n,  and  as  well  we  are 

n -^n  ’ n 

tacitly  using  the  trivial  facts  that  is  also  the  o-field  gener- 

ated by  {X^  l<ianl  and  ^n  ^^2  o-field  generated  by 
(Xn^i,  m>2  < i < 2^^}. 

We  proceed  to  verify  that  (2. 3. 8) -(2. 3. 10)  hold.  First  we  have 


Var  W 


I E X^  . = I 
i odd  ^ ^ i o 


4 — = 1 , for  all  n. 


odd  I a 
n n 


by  stationarity , so  that  (2.3.8)  obviously  holds. 

Next,  using  stationarity  :ind  for  convenience  writing  p^ 
1 - f'(u^).  we  have,  assuming  9.^  > 1, 


*,(n)  ■ 'iV'CC,'",,]  ■ "n>} 

■ Vn«-Pn'  * 2 J C,.j>u„ 

J=1 


) - 


J=1  n 

“r^  j-{a  -3  } 

= 3 p (1-p  1+2  y 2 — 0-  j pfr,>u  , f 

” " ” i=a  -3  +1  J ' 

■'  11  n 


23  %■  ^ 


" “nl’n**-'V  * <T^  jlj  5l»j*“n) 


23  “r* 


A^’-Pn^  " -ir  .J,  A-j)(P{Ci>u^, 


^ n , ,-,2 

+ 75—  a (a  'IJp 

a - 3 ri  n ' n 
n n 


3„i 


r f’ril  " 

+ 2 y (o  -jui’f 

“J  i = I '1  ^ 


n n IV  ) = 


3 , 3 

n 2 , II 


26*  “„•> 


" i-  • r Vn  ' i^TsrVf  i,  i“n-j'(>’«, 

n 1 - J1  ir  II  n j = ] 


From  (2.3.2)  and  tlie  relation  p we  have 

' n n 


(2.3.11) 


a“  = u p (1-p  ) + o 
n II*  n * n 


so  that 


3 a p 3 k 

n n*^n n n 

3 T n 

(1 

“n  " 


which  tends  to  zero  by  (2.3.1),  and  also 


23^  ““n'^ 

a:a„K-3„l  i = l " ^ ^ " 
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from  which  we  obtain 


2£n-2 

(2.3.12)  y K . 
i even 


(in-l)Var  W Var  W , 

. 0 

2 2 

£ o 

n n n 


2 ra  +2B 

Also,  clearly  K 2i;,  ^ » which  tends  to  zero  since 

n n 

= o(k^).  ITiis  combined  witli  (2.3.12)  gives  (2.3.9). 

Finally,  for  each  1 < i s 2£^  the  r.v.  W is  bounded  above 

^i 

by  a + 2B  , so  that  )X  J is  bounded  by 
n n n j i 


a +2S  rci 

OpL 


vT'  a '4P 
n n n 

which  tends  to  zero.  Thus  for  each  e > 0 we  have  that 


for  all  sufficiently  large  n,  depending  on  e,  so  that  (2.3.10)  holds, 
and  hence  the  proof  of  the  lemma  is  complete. 


ITie  main  result  is  now  immediate. 

llieorem  2.3.3.  Let  r,^  be  a stationary  sequence  of  r.v.'s  with  mar- 
ginal d.f.  F ;uid  an  intennediate  rank  sequence.  Suppose  the 

level  u^  satisfies  (2.1.1)  for  some  real  u and  let  be  the 

number  of  exceedances  of  u^^  by  f,j,  ...  . If  A2  holds,  then 

P(W^  < k^)  ♦ <*>(u)  as  n >■ 


Proof:  U'c  liave 


/■  a k -ap 

i'(w  < k 1 = p y X . < — — ” 
n n a,i  ^ 


where  = L - and  o“  is  givea  by  (2.3.7).  Usiag  (2.1.1), 

(2.1.7),  aad  (2.5.11)  we  liave 


k -np„ 
a ‘ a 

A 0 

a a 


Li  ;i.s  a * «>, 


;md  the  result  follows  by  heinma  2.5  ^ 


We  may  also  state  the  correspoading  theorem  giving  sufficieat 

eonditioas  under  which  has  I'la  asymptotic  distribution. 

^n 

Tlicorem  2.5.1.  Theorem  2.2.15  remains  valid  if  in  place  of  , 
assumption  A,  holds  for  u,^  = a^^x  + b^^  with  u = u(x)  for  all  x 
such  that  n < G(x)  < 1. 

[•Lnaliy,  we  restate  our  conditions  and  result  for  cons ider/it Jon  of 
snwllest  rank  tenns  . 

A’,:  For  the  givea  sequence  u^^  satisfying 

k cfT<  ■ 

^ a a a I n j 

for  some  real  number  u,  there  are  sequences  {u^,  3^^;  n.>l } subjf"*  to 
(2.1.5)  such  that  = o(»^.)  and  3,^k^^  = o(n),  for  which 

^n'  ^ k 

“n‘  .y  ■ o(m) 

.1  = 1 

as  a > aad  (2.5.5)  holds,  as  defined  in  the  assumption  A,  . 


I 
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We  then  have 

nieorem  2.3.5.  ITieorem  2.2.14  remains  valid  if  in  place  of  AJ  , 
assiDnptiori  holds  for  ii^  = a^x  + with  u = u(x)  for  eadi  x 

such  that  0 < Gfx)  < 1. 

2.4.  The  Normal  Case. 

.‘\s  we  noted  in  Section  l..S  the  standard  nomuil  law  <3>(x)  belongs 
to  its  OW71  domain  of  attraction  for  iiny  intermediate  sequence  of  riglit, 
or  left,  nmks,  ;ind  therefore  the  theorems  we  have  presented  in  this 
chapter  arc  applicable  to  stationaiy  normal  sequences.  Since  for  a 
given  value  of  the  mean  of  f,j  a stationar>’  nontial  sequence  is 

specified  by  its  set  of  covari;mces,  one  would  hope,  just  as  in  the 
fixed  nmks  case,  to  find  simple  covariance  conditions  implying  our 
assuiiTpt ions  for  general  stationary'  sequences.  As  might  be  expected,  in 
oi'dcr  to  satisfy  the  general  conditions,  whicli  involve  the  considera- 
tion of  more  events  than  just  those  relevrmt  to  extreme  order  statis- 
tics, we  will  rerpiiic  rates  in  which  the  covariances  tend  to  zero  that 
arc  subst.mt ial ly  faster  th;m  (1.2.17),  (1.2.18),  or  (1.2.19).  For 
convenience  we  will  deal  exclusively  with  standard  (that  is,  zero  mean, 
unit  vari.'uice)  noniial  sequences,  since  results  obtained  for  this  case 
can  be  easily  trrms formed  to  other  normal  sequences. 

Iluis  suppose  tfiat  is  a standard  stationary  normal  sequence, 

that  is,  has  nuirginal  d.f.  'l(x),  rmd  let  r^^  = K . n ■ I, 

denote  the  corresponding  sequence  of  covariances.  Let  be  an 

intermediate  r;mk  sequence  ;md  for  a given  real  number  x,  suppose  the 
level  u^  satisfies  (2.1.1)  with  u = u(x)  = x,  that  is. 
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(2.4.1) 


1 - 4>(u  ) = -- 
n n 


il  + 


n 

n 


as  n ->■  “.  t)iie  such  u is  of  course  u = a x + b where  a ;uicl 

n n n n n 

h^  are  given  by  (1.5.19),  with  F = 4>.  Continuing  to  let  denote 

the  niunber  of  exceedances  of  u bv  C,,  ...  , we  have  as  our 

n ' I n 

objective  to  obtain  conditions  on  the  covariances  i’  luuler  which  A, 

or  At  hold.  It  will  then  follow  by  our  previous  theorems  that 

I’l'V  • k ) ► 'Hxi,  ^i-nd  hence  also  that  the  order  statistic  , C*"*  is 
■ n n 

.asyiiiptot  ica  1 ly  nonnal . 

We  will  be  assuming  that  the  covari;mces  r^^  tend  to  zero  as 
n - a condition  apparently  essential  in  order  to  have  the  rec|ui red 
"approximate  independence"  between  r.v.'s  far  apart  in  time,  and  it 
will  be  convenient  to  define  the  quantities 


(2.4.2) 


6 = sup  |r  I 
n :1 


and 

(2.4.3)  6 = sup  1 r I . 

m.-n 

As  has  been  indicated  by  Beman  (1964),  the  asstimj^tion  r^^  ->•  0 implies 

that  6 < 1;  this  iiuiy  be  seen  from  the  fact  that  if  6 = 1,  then 

|r^|  = 1 for  some  n ^ I,  ;md  hence  |r^|  = 1 infinitely  often. 

Also,  it  is  clear  that  for  each  n > 1 there  is  an  integer  m^  ? n 

such  that  6 = r : thus  if  t is  a sequence  of  positive  numbers 
n m n 

n 

monotonical  ly  increasing  to  infinity,  and  if  r^^t^^  remains  hoimded  as 

n >-  then  since  6 t < r t for  each  n > 1,  the  sequence  6 1 
n n m m n n 

n n 

is  also  boimded. 

We  begin  the  dev^elopment  by  giving  some  useful  preliminary  tech- 
nical results  pertaining  to  normal  sequences.  First,  using  the 
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f^uiiiliar  relation 


1 - <I>(y) 


^’(y) 


as  y 


we  hav'c,  for  defined  by  (2.4.1), 


so  that 
(2.4.4) 


1 - 4.(u  ) 


-u:/2 


/In  u 


, -uV2 

^ e " 


n 


n n 


By  taking  logaritluns  it  follows  that 


2 

- 2 log  ^ + 2 ioU  log  2ti  > 0, 

or 

u;  = 2 log  ^ ^ o(u^) , 

so  that 


(2.4.5) 
Hence  also, 


2 log 

n 


from  (2.4.4)  ;ind  (2.4.5)  we  have 


(2.4.6) 


*) 


" n 

We  will  also  require  the  following  result,  various  forms  of  which  have 
been  used  extensively  in  consideration  of  extreme  order  statistics  for 
normal  sc<]uences  by  a niimber  of  authors,  including  Rennan  (1964)  and 
Leadbetter  (1974b,  1977).  The  precise  statement  of  this  result,  which 
we  give  in  a form  suitable  for  our  purposes,  is  implicit  in  the  proof 
of  Lennna  6.^  of  Leadbetter  (1974a);  however  for  clarity  we  pi'ovide  here 
a sketch  of  most  of  the  details  of  proof. 


J 


1 
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I.eiiiina  2 . 4 . L . Let  r be  a standard  stationary  normal  sequence  and 


suppose  that  r^  = li  ^ 0 as  n ^ For  p,q  > 1 let 

ip 

mmiber  u, 


ij,  , j|,  ...  be  distinct  integers.  'Hien  for  each  real 


-u,  .. 


su,  C-  <u,  ...  ,F.  ml 

p -'i 


- P(C.  su,  ...  ,Q  "ulP[c.  ru, 

i 1 -I-  1 


■ ^-‘0! 
•^q 


[2.4.7) 


< K i p.  • 
■ ■ ij 
1,1 


-11  /(1+IP-  ; I) 

» ^ > J 


for  some  finite  constant  K depending  only  on  6,  defined  by  (2.4.2), 


where  p-  . = P f.^.  = r,.  for  icl  = {i,,...,i],  jc;J  = 
1 ,.l  1 J lj-i|  1 ’ p'  ’ 


{jp--->j,|K  iiiiii  till-'  i^uinniation  is  taken  over  all  j)ossible  pairs  i , !, 
j c J. 

Proof;  We  write 


P(f.  -lii,  ...  ,f,.  -u,  f.  cu,  ...  <u) 

M ‘p 


J.„,  ••• 

f “ 

J 


•••  )d(y, \’  „) 


p+(l 


fl(v)dy  , 


where  f,  is  the  joint  density  of  , ...  ,L- 
1 - ' 1 , 1 

1 P 


,r. 


'1 


q 


.\ow  fj  is  based  upon  the  covariance  matrix  Aj  , say,  which  may  be 
partitioned  into  a 2 '<  2 block  matrix  whose  principal  diagonal  blocks 
contain  tlie  covai'iances  between  the  F, ,£[.  and  between  tlic 

F^.  , ...  ,f'.  , ;ind  whose  other  blocks  contain  the  covariances  between 


and  F,.  for  all  pairs  i ,j . Now  let  A„  be  the  matrix  of  the 


L 
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s;une  duncnsion  as  and  having  the  s;une  elements  in  the  respective 
principal  diagonal  blocks  and  zeroes  elsewhere.  For  0 s Ii  i ] define 
the  mati  ix  - hA^  + (l-hiA^^  , and  let  be  the  (zero-rneanj  nomuil 
density  based  on  . ( Aj^  is  easily  seen  to  be  a covari;ince  matrix.! 


= •••  r fyjdy  . 


so  that 


^u,  ...  f u.,  ...  ,5  <u)  = F(l) 


5-U,  ...  ,f  <u)p(f  <u,  ...  ,C.  <u)  = F(0J. 

I 'p  Jl  Jq 

Then  the  left  side  of  (2.4.7)  is  1F(1)  - F(0)|,  and  we  liave 

fl 

lF(l)  - F(0)1  < lF'(h)ldli, 

•'0 

where 


u r atyy) 

-inr- • 


Now  if  wo  were  to  write  dovvii  explicitly  the  multidimensional  normal 
density  f,j(y),  we  would  see  that  it  depends  on  h througli  the  compo- 


nents A.^.,  of  A,^  , so  that 


;)ihd) 

aTT' 


i,ib  luJ  ' I,i 


;ind  therefore 


F'(h)  = 


ltd,.]'.)  •'  ^ I ,j 
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since  A.  - o.  if  i and  i'  arc  both  in  1 or  both  in  d, 

1,1  1,1 

:md  A.  .,=hp.  •,  if  iel  ;md  i'  t .1  or  i e J and  i'  c I. 

1,1  1,1 

Then,  using  the  fact  that  tlie  derivative  of  a multidimensional  nomtil 
density  with  respect  to  a covari;mce  element  is  equal  to  the  second 
mixed  derivative  with  respect  to  the  corresponding  variables  (sec 
th'amer  and  feadbetter  (19b7,  Ikiuat ion  2.10.3)  ),  we  obtain 

' u f s'fuCy) 

"'"■’I  'IvJ 

and  integrating  and  >'j  leads  to 

ll^'UDl  s I Ifi  f •••  ) ‘'h^>'i  " ’ 

i.  I J J 


where  ~ function  of  p + q - 2 variables  ob- 

tained by  putting  y.  = y-  = u into  fj^  , and  the  integration  is  over 
the  rcmaini/ig  lai'iablcs.  J'Or  eacli  pair  i,_i  we  can  dominate  this  last 
integration  by 


lyxi  ■ yj  ■ "ur  ■ 


which  is  iiist  tlie  tii\'ariate  noniial  density,  evaluated  at  (u,u),  of  two 

standatal  norni'il  r.\.'s  witli  covariance  hp-  ■ . Hence  a little  ob- 

^ » J 

vious  estimation  gives 

-u^/Cl+lp.  .1) 

(2.1.9)  |l'(h)l  - ^ . 1 ^ IPijKl  - ^ 

1-  1 ,.1cJ 

for  0 < h • 1.  Now  r *•  0 implies  that  r^^  is  bounded  away  from 
•1,  that  is,  3 < 1 , by  our  earlier  remarks,  so  tliat  ^ 

bounded  above.  Hie  conclusion  now  follows  from  (2.1.8)  and  (2.4.9). 
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By  merely  making  appropriate  changes  in  the  limits  of  integration 
appearing  in  tlie  previous  proof  we  can  verify  the  following  result. 

Lemma  2.4.2.  Let  lie  a stajidard  stationary  nonnal  sequence  witli 

covariances  r^^  > 0.  for  p^,  p-, , qj  , ;uid  q,  > 1 let 


ip  •••  >ip^’  •••  Jr  •••  >jq^’Ji>  •••  ’-iq 

he  distinct  integers.  Then  for  each  real  u, 


II 

I! 

' ’’^'2 

• PfCj'-U, 

9 

■’•'q2 

^ 1 U'i  j 1 

i,.i 


-u7(i  + lp.  _.|) 


for  some  K depending  onlv  on  6,  where  o.  . = L f.f.  = r, . . , for 

" ■ M,.|  ’i7  |j-j| 

' ' ' ■ 'h h,’  0 Si'  ‘h jq,>  ji’-"--';,,'- 

and  the  simi  is  taken  over  all  pairs  of  such  i,j. 

As  special  cases  of  tlie  above  results  we  have  that  for  i < j and 
any  rea 1 u , 


(2.4. lOJ  |l’{fj  !i,  i-'u)  - 4T(u)|  < K |iv_.|  e 


and 


(2.4.11)  |l’(fj>u,  rj>ii)  - fl  - 4(u))“|  • K |rj_j 

for  some  K depemling  only  on  6. 


'■V(17r.  -I) 


1-1 


-ir/(l  + l r . 


J-' 
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IVc  are  now  ready  to  consider  the  noin  problem  of  obtaining  covari- 
ance conditions  for  noniial  sequences  under  which  our  general  dependence 
conditions  in  this  chapter  are  satisfied.  In  doing  this  it  is  most 
convenient  to  deal  with  the  assumptions  ;ind  separately,  al- 

though for  each  we  employ  the  results  just  presented  in  somewhat  simi- 
lar ways,  first  wo  consider  covariance  conditions  sufficient  for  . 

for  the  given  standard  stationary  nonnal  sequence  with  co- 

vari;mces  r^  , let  us  suppose  that 

(2.4.12)  r^^  = 0(e’"'') 

for  "^ome  p > 0.  Now  assimie  that  for  the  intermediate  rank  sequence 
kj^  , with  0 defined  by  (2.1.. 4),  we  have  satisfied  the  relations 

(2.4.15)  0 < ^ , 

wliere  6 = sup  |r  and  also 
n>l 


Ihe  covariance  condition  (2.4.12)  is  of  course  subst;mtial ly  stronger 
than  those  conditions  used  for  tlte  fi.xed  ranks  problem,  but  it  is 
nevertheless  reasonable  in  view  of  tlie  fairly  strong  "mixing"  condition 
(2.2.(i).  for  the  given  nomial  sequence  the  relations  (2.4.15)  and 

(2.4.14)  of  course  impose  additional  restrictions  ujinn  what  inteniiedi- 
ate  rank  seiiuences  k^  may  lie  considered,  bt'vond  t*- ' requirement  tliat 
0 < I , if  the  liave  Iiigh  degrees  of  correlation,  that  is,  5 is 
"close"  to  one,  or  if  the  specific  exponential  rate  p > 0 indicating 
how  rapidly  r^^  tends  to  zero  is  smtill.  It  thus  seems  appropriate 


I 


that  we  provide  an  intuitive  e.\p];inat ion  as  to  why  these  restrictions 
might  be  needed.  I'irst,  we  note  that  (.2.2.4)  implies  that  the  proba- 
bility of  occurrence  of  more  than  one  exceedance  of  u in  any  one  of 

n ^ 

the  odd- indexed  intervals  ...  ,l2£  constructed  in  Section 

n 

2.1  tends  to  zero  as  n ->•  “ (Lemma  2.2..v).  Tlvis  suggests  that  we 

cannot  have  simultaneously  the  level  increasing  too  slowly  as 

n -*■  <»  and  a high  degree  of  correlation  between  any  two  r.v.'s  and 

; for  if  this  vvere  the  case  we  would  e.xpect  to  have  at  least  one  and 

actiu'illy  more  than  one  exceedance  in  perhaps  several  of  the  odd- indexed 

inteivals.  Now  it  is  easily  seen  that  the  rate  at  which  u increases 

n 

is  inversely  related  to  that  of  . Hence,  for  a giv^en  normal  se- 
quence with  high  degrees  of  correlation,  we  should  not  expect  our 
construction  to  be  applicable  to  consideration  of  intermediate  rank 
sequences  k^  for  whidi  0 is  "large."  Secondly,  when  0 is  large 
our  construction  requires  that  A iind  q be  chosen  small 

~ n^,  ~ n^) , according  to  (2.2.3),  ;ind  from  (2 . 2 . 5)  - (2 . 2.b) 

this  makes  necessary  a more  rapid  exjvonential  rate  of  distributional 
mixing.  Tlien,  in  making  use  of  Lemma  2.4.1  this  corresponds  naturally 
to  a faster  exponential  convergence  of  the  covariances,  which,  as  it 
turns  out  for  computational  purposes,  leads  to  the  restriction  (2.4.14). 

Now,  as  we  have  already  noted,  given  the  intcmiediate  rank  se- 

*> 

c)ucnce  k^^  sucli  that  0 < ^ , there  always  can  be  found  a system 

Pn>  n l)  satisfying  (2.1.5),  (2.2.1),  ;ind  (2.2.2),  and  in 

fact  there  is  such  a system  in  wivich  ot  ~ n^'  for  some  A, 

n 

0 < A < 1 - 20,  and  ~ n*^  , 0 < VJ  < That  (2.2.4)  Ivolds  with 

~ n^  for  any  A satisfying  0 < A < 1 - 20,  is  easily  obtained 


from  the  following  lemma. 
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Leiimia  2.4.3.  It  the  covari:mces  satisfy  (2.4.12)  for  some  p > 0,  and 
if  0 < , then 


(2.4.15)  n I |r 
j=l  ^ 


-uyo+lr-.l) 

e ■ 0 as  n *■  “. 


l’_fooj  : Choose  > such  tliat  0 •-  y • ''“'c  split  the  summation 

(2.4.15)  into  tvvo  parts,  the  first  from  j = 1 to  [n^]  and  the  second 
from  [n'’]  + 1 to  n.  ( [•]  denotes  tlie  greatest  integer  function.) 
ilien  l)v  (2.4.5)  we  liavc 


-uyti.ir  n „ 

n 1 h'  • I < n e 


J = 1 


'1^^'  (log 


n ^ 


1<  'I  TTJ 
n 


< Kt  (log  n)  n 


r(l+6)-l+:o+6  , 

1 1 p ' rK 


1+5 


for  some  constants  K,  and  K,  , and  this  last  quantity  tends  to  zero, 


by  the  choice  of  y,  and  since  = o(n^^^)  for  every  r.  > 0.  Also 


we  tiave 


n 

n I 

J=[n^]+1 


-ir/()+|r.|)  ^ 

[ I n ^ p 

1 r . c - i n 5 

I ' 


-u7(]+6  ) 

" [nP 


K,  (lo«  f ) 


[n^] 

i/n+5  ^ ) 

[n^] 


2/U+5  ^ ) 

[ri^] 


and  since  6 = 0 

[n^] 


< K,  n k (log  n)  5 


[n^l 


, the  last  expression  tends  to  zero.  Com- 
bining both  siuiis  gives  the  conclusion. 
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Lenmia  2.4.4.  Under  the  conditions  of  the  previous  lemma, 

vvhere  ~ n^  , for  any  choice  of  A such  that  0 < A < 1 - 20. 

Proof:  Using  {2.4.11)  we  hav'e  for  some  finite  K, 

T “n"^  -uV(l  + |r.|) 

” " ” “n^^  ■ ^ I lr:|  e ” J 

j-1  j=l 


< n a fl  - $(u  ))"  + K n I |r  J 

j = l J 


-u;/(l+|r-n 


for  all  large  n.  Ihe  first  tenn  on  the  right  tends  to  zero,  since 

k 

1 - 'Hu^)  ~ — - ;md  = o(n),  and  the  result  follows  from  the 

previous  lemiua. 

I'he  next  result  provides  a sufficient  condition  for  (2. 2. 5)  - (2. 2. 0) 


to  hold. 

for  given  seciuences 

of  integers  :ind 

^n  • 

I.enma  2. 

K » 

4.5.  {2.2.5)-(2.2.6) 

is  satisfied  if  3 

n 

is  such  that 

of  1 

0 e 

for  some  > 1 - 

A,  where  ~ n^  , 

0 < A < 1. 

Proof: 

Por  integers  ^ - ij 

< < ip  ^ .ii  < ... 

< j < n we 

have  by 

I.cmma  2. 

4.1. 

lP(fj^  Un,  ...  ••• 

- • 

-u^/(H|p  I) 

■ K I |Pi  ;l  e " ’’-1  , 

for  some  constant  K,  whei’e  (u  j = P.  gjr.j  for  i = i^,  .. 


. . , r,  • <u 

1 IV 

• q 


, i and 
P 


85 


j = jp  •••  >jq  • Kut  for  jj  - ip  > 6^  we  see  tint  this  quantity 
does  not  exceed 


K n“  6g  e 


(io8 


- I<2  Hog  n)  6 tik^ 


for  some  constants  and  , and  for  all  large  n.  Tlius  if 

_n'‘n 

iS  = 0(e  ^ ] for  some  k..  > 1 - A,  then  the  last  expression  abov^c 


m: 


lay  be  written  as  0(e  ) for  some  k,  ic^  > k > 1 - A. 


It  only  remains  for  us  to  indicate,  under  our  conditions  and 
restrictions,  how  the  system  of  integer  sequences  {a^^,  6^^,  s^;  n>l} 
may  be  chosen  in  such  a way  that  the  hypothesis  of  the  previous  lemiiui 
is  satisfied.  We  do  this  and  summarize  our  discussion  of  obtaining 
covariance  conditions  sufficient  for  in  the  following  theorem. 


riicorem  2.4.b.  Let  f,  be  a standard  stationaiy  normal  sequence  with 

" ’ P. 


covariances  r = L ^^uc 

n 1 iiH 


:h  tliat  r^^  = 0(e  ^ ) for  some  p > 0. 


1-6 


Let  be  an  intemediate  rank  seciuence  such  that  6 = 0({k^})  < , 

■>  / 5 n 

wliere  6 = sup  r , nid  aNi'  ■ ■:  - — . Suppose  for  a given  real 
n 1 ^ ^ 


number  x the  1 ‘v 


n 


at  I sf ies 


k X i^TT 

i u ) = '*  - — + o 

n n n 


evTT  ^ 
n 


Ihen  assumption  Aj  holds,  so  tliat  by  ITieorem  2.2.5  we  have 


l’(W  ■.  k ) ^ 0(x)  as  n *■  <», 
n n 


where  W’^  is  the  number  of  exceedances  of  u^^  by  Cp  ••• 


r 


8f) 


’*roof  (0  > 0):  Take  ~ n'^  mid  6^^  ~ where  0 < p < A < 1 are 

chosen  such  that  pp  > 1 - A > 0,  and  let  the  sequence  s = ofv'TT^  be 

n n 

chosen  arbitrarily,  llien  by  Lemma  2.4.4,  (2.2.4)  holds,  and  since 


Leinimi  2 . 4 . .S . 


where  pp  > 1 - A,  (2.2..S)-(2.2.6)  is  satisfied,  by 


(0  > 0):  Let  0 < c < min{l  - -0)}  and  choose 

1 - ^ - c ;md  A = 1 - 20  - ^ . Also,  let  ~ , where 


V = ^ - 


j > 0.  riien  the  relationships  (2.2.2)  are  satisfied  for 


a ~ n and 
n 


=0 


d'U' 


n^  , and  by  Lemma  2.4.4,  (2.2.4)  holds.  Moreover 


wliere  p i — , and  hence 
^ - 0 


pp  - (1  - ^ - e)  ^ 


= A- 

“ 5-0 


> 20  + e 

> 1 - A. 


Ihus  with  K|)  = pp  we  see  that  (2.2..S)-(2.2.b)  holds  by  Lemma  2.4.5. 
Ihis  completes  the  proof. 


It  is  clear  that  the  system  (a^,  3^^,  s^^;  n>l  1 as  chosen  docs  not 
depend  on  x.  The  following  re.sult  giving  the  asimiptotic  distribution 
of  the  largest  order  statistic  ^ is  thus  an  immediate 

corollary. 


Iheoreni  2^4.7.  Under  the  srune  covariance  condition  ;md  restrictions  on 

k as  in  the  previous  theorem,  for  each  real  x we  have 
n ' 


L 
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as  n ->•  whore 
is, 

and 


. - h 

K n 

" - - < X 


a 


n 


->  'I'(x) 


a^^  and  arc  given  by  (1.3.19),  with  I-  = <1,  th.at 


•Kb  ) = 1 - J- 
n n 


A~ 

_ n 

'*n  n4’ ' (b  ) 

n 


Rcnurk;  It  is  clear  that  for  consideration  of  inteniiediate  rank  se- 

((uences  k^^  for  which  G = 0,  if  {2.4.12)  bolds,  then  (2.4.13)  and 

(2.1.14)  .ire  aiiroituit ica  1 ly  satisfied.  In  fact,  it  is  possible  in  this 

case  to  weaken  somewhat  tlie  requirement  of  ;in  exponential  rate,  in 

accordimce  witli  Remark  2 in  .Section  2.2.  Suppose  for  the  system 

{u  , b , s ; nl)  given  by  (2. 2.1b)  we  have  that 
n n n ^ ^ 


r = 0 
n 


IV- 


('■'Wn)] 


k “M 

f-1  ( n ) 


1.2C2 

\rl(n) 


•1, 


log  1-'  (n) 

where  3 '(n)  is  an  integer  such  that 


V'(n) 


= n.  It  follows  that 


6 =0 
n 


f ^ h '2  I 
k ‘ + 1 1^2r„ 

n 


log  n 


.ind  moreovei'  we  see  reatlily  that 
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for  each  0 < y < 1-  /\n  inspection  of  the  proofs  of  Leiranas  2. 4. 3-2. 4, 5 

reveals  that  we  can  now  verify  (2.2.4)  and  (2.2.5),  with  the  rate 
(2.2.17). 

We  now  turn  to  the  task  of  developing  covariance  conditions  under 
which  the  assvonption  liolds.  In  doing  this  we  will  oniploy  methods 
similar  to  tliose  we  liave  seen  for  oljtaining  conditions  sufficient  for 
Aj  , using  our  establislied  tedtnical  results  applying  to  noniuil  se- 
quences. The  e\qx)iiential  I'ate  in  wliicli  the  covariances  tend  to  zero 
will  again  he  appropriate,  this  in  the  first  place  resulting  from  the 
"slow”  rate  in  wliich  the  level  u^^  increases,  and  secondly  owing  to 
the  fact  that  we  will  deal  with  the  condition  (2.3.6),  rather  than 
(2.3.3)  directly.  We  will  also  imi)Ose  certain  restrictions  upon  wliat 
intennediate  rank  sequences  k^  can  be  considered,  for  a specified 
e-cponont ia  1 rate,  but  these  will  be  substantially  different  from 
(2.4.13)  and  (2.4.141,  in  that  we  adjiiit  sequences  k^  for  which  0 is 
"large." 

Thus  again  let  he  a standard  statioiviry  normal  secjuence.  We 

suppose  now  that  the  covariances  r^^  satisfy 

(2.4.16)  r^^  = 0(e  } for  some  p > 3. 

I.et  kj^  be  an  i ntcniied iate  rank  sequence,  subject  initially  to  only 
the  restriction  that  0 < 1,  and  for  a given  real  x choose  the  level 
Uj^  to  satisfy  (2.4.1).  .'\s  the  following  result  shows,  the  condition 

(2.3.2)  holds  for  any  sequences  (t^^,  6^^  satisfying  (2.3.1). 

hemma  2.4.8.  If  the  covariances  satisfy  (2.4.16)  and  if  for  the  inter- 
mediate rank  sc-qiience  k^^  such  that  " tlie  sequences  and  (i^^ 


r 


H9 


arc  chosen  subject  to  (2.3.1),  then  (2.3.2)  liolds  for  given  hy 


(2.4.1),  for  any  real  .x;  in  fact,  for  each  such  u^  we  liavc 


[v^l 
n 


'n  i = l 


I - (1  - 'Hu^))“|  - 0,  as  n- 


I’roof:  Since  r^  >■0  vve  liave  6 < 1,  and  since  0 < 1,  tlic  ([uantity 
1 - 0 - 3 + 03  = (1-6)  (1-0)  is  ]5ositive.  llius  we  iiuiy  choose  y sudi 


tliat  0 < Y < . Splitting  tlie  given  siimiiution  into  two  parts, 

' l+o 

as  in  tlie  proof  of  l.ciiDiia  2.4.3,  we  have  first  tliat 


r 4,  "’'.-r'v  iu'-n'  - ■ ”(■',.'1-1 

n j=l 


[n^]  -ir/d  + kjl) 


n '-y  n 
k I e 


St  i = l 


for  some  constant  K,  by  (2.4.11),  and  by  (2.4.6)  the  quantity  on  the 
right  side  does  not  exceed 


■'ll  Si  ^n 


n 


< K,  (log  n)  n 


u(oj4-.  - l]+ln-2/(l+6)  A ,,2/(d3)-l 


n 


1-3 


= K,  (log  n)  n 


Y(l-t-3)-l+6+0-06  , 


1+3 


n 


0 


foi'  some  constants  Kj  and  K,  . llicn  by  (2.1.4)  ;md  the  choice  o( 

Y,  this  expression  tends  to  tero.  Ilie  proof  is  complete  if  it  is 


possible  to  choiise  y such  that  *'  n^  for  all  large  n.  Othci 


wise  for  n such  that  '■  n’  we  have 


I 

J 
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l-  I |l’(C,-'n’ 
,i=[..']*l 


< K 


n 


6 c 

[n^] 


'ir/ii+iS  J 
” [n^] 


V K,  /[T  (log  n)  6 , 

^ " [i/] 


which  clcarlv  tends  to  zero,  since  6 = 0 

[n^] 

follows  upon  combining  tlic  two  sumimit ions . 


JO 


Tlie  result  then 


We  now  sliow  tliat  (2. 3.0)  holds  for  tlic  level  u^^  given  by  (2.4.11 
if  the  covariances  satisfy  (2.4.1b).  To  tlo  this  we  make  the 

additional  restriction  upon  that 


- < 0 < 
P 


P-1 

P 


(.Note  p > .3.)  Iben  we  may  choose  sequences  of  integers  ~ n^  and 

3 ^ n*"*  , wliere 

n 


(2.4.17) 


p < A < 


0 

'} 


and 


M + e < 1 . 


It  is  clear  that  the  relationships  (2.3.1)  are  satisfied,  and  li\  tb 

previous  lerniia,  (2.3.2)  holds.  ,\e.\t,  we  fi.x  n (large)  a-J  . 

1 ■ m • n - ('  , and  let  A.  .and  B.  be  events  >4'  tb,-/  - 

n 1 j 

-r  “^s 

that  is. 


1 

-r 


ir’ 


r. 

1 
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where  0 < r < ni,  0 < s < n - m + 3^^  , is  a subset  of  r of  the 

first  m positive  integers,  and  is  a subset  of  s of  the  inte- 
gers from  m + 3^  + 1 to  n.  'Hien  by  Lemma  2.4.2  we  have 

2 

|l’(Ai  Bj  ) - l'(A;  )I>(B,  )|  < K [ Ip  I 
_r  -Is  -r  *fs  ij 


where  Pj^  j - E and  the  summation  is  taken  over  all  pairs  i,j 
such  that  1 < i < m and  m + 3^^  + 1 ^ j s n.  llie  right  side  above 
not  exceed 


But 


,,  2 , 
K n 6 

= 0(e'" 


UP 

) 


-u2/(H6g  1 

e " '^1 

, and  by  (,2.4.17) , 


(log  n)n  k 6 . 

UP  > 1.  Then  taking  the  supre- 


mum  over  all  choices  of  indices  i , i , and  all  m,  1 < m < n - 3 . 
we  see  that  (2.3.6)  holds,  which  implies  (2.3.3).  Summarising,  we  have 
proven  the  following  result. 


n^eorem  2.4.9.  Suppose  is  a standard  stationary  normal  sequence 

with  covari;mces  r^  = > n > 1,  satisfying 

r^  = 0(e‘"^] 

for  some  p > 3.  Let  k^  be  an  intennediate  rank  sequence  for  which 

i < e < -2211 

P P 

where  0 is  defined  by  (2.1.3),  and  suppose  the  level  u^  satisfies 
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k x^lT"  /vlT’' 
1 - <i>(u  ) = -2.  - — H + o 

n n n n 


for  some  real  x.  Tlien  holds,  so  that  by  Theorem  2.33, 


P(Wj^  < kj^)  - 4.(x) 


as  n ->  °o,  where  W is  the  number  of  exceedances  of  u b/ 
n n 

...  ,5^  . Moreover,  it  follows  that 


• ‘’n  1 

p ^ < X -)■  (Jifx) 

^n 


for  all  real  x,  where  the  normalizing  constants  a^^,  b^  are  given  by 


$(b„)  = 1 - -L 

n^  n 


Finally  we  mention  that  results  corresponding  to  the  last  state- 
ment of  the  previous  theorem  as  well  as  to  Theorem  2.4.7  can  be  ob- 
tained for  consideration  of  smallest  rank  terms,  and  we  state  these 
formally. 


'Dieorem  2.4.10.  For  the  standard  stationary  normal  sequence  , if 
the  covariance  conditions  of  either  llieorem  2.4.6  or  Theorem  2.4.9  are 
satisfied,  along  with  the  respective  restrictions  on  k^  , then 


4"^  - 

k n 
n 


< X ->  <J>(x)  as  n > «>, 


for  all  real  x,  where  a^  and  h^^  are  given  by 


4(b  ) = -41 
n n 


CHAPTER  III 


JOINT  DISTRIBUTIONS  AND  THE  MULTI-LEVEL  EXCEEDANCE  PROBLEM 

We  now  exajnine  the  problem  of  obtaining  the  asymptotic  joint 

distribution  of  two  or  more  order  statistics  from  the  same  E,  se- 

n 

quence,  as  well  as  tlie  related  problem  involving  the  limiting  joint 
distribution  of  the  numbers  of  exceedances  by  E,  of  two  or  more 
appropriately  determined  levels.  We  first  deal  with  the  i.i.d.  se- 
quence case,  where  several  results  are  already  knovm,  and  then  we 
turn  to  tlie  case  in  which  the  E^^  are  identically  distributed  but 
exhibit  dependence  of  the  type  we  have  previously  considered. 

3.1.  The  I.i.d.  Case. 

In  Section  1.2  we  discussed  the  asymptotic  distribution  of  two  or 
more  fixed  largest  or  fixed  smallest  rank  order  statistics  from  i.i.d. 
sec|uences.  Other  results  giving  the  asymptotic  distribution  of  two  or 
more  central  rank  terms,  as  well  as  the  limiting  distribution  of  sever- 
al fixed  rank  terms  and  central  rank  terms  considered  jointly,  have 
also  been  obtained  by  Lobve  (1956).  In  each  of  these  instances  it  is 
assumed  that  the  corresponding  marginal  or  one -dimensional  limiting 
distributions  exist.  Moreover,  as  is  easily  seen  from  Lobve's  results, 
the  expressions  obtained  for  the  limiting  joint  distributions  of  sever- 
al fixed  smallest  ;ind  largest  rank  terms  and  central  rank  terms  may  be 
factored  into  the  corresponding  distributions  for  these  three  classes 
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I 


I 


i 

1 


of  rank  sequences;  that  is,  the  largest  rank  terms,  smallest  rank 
terms,  and  central  rank  terms  are  asymptotically  mutually  independent, 
wlien  the  limiting  distributions  exist  individually. 

We  have  been  able  to  extend  these  results  to  include  intennediate 
order  statistics,  and  for  smallest  and  largest  rank  intermediate  terns 
simultaneously.  Our  conditions  also  include  the  existence  of  the 
corresponding  one-dimensional  limit  laws,  as  well  as  a restriction  upon 
the  several  intermediate  rank  sequences  being  considered.  As  is  clear 
from  the  first  and  our  main  new  result  below,  intermediate  terms  and 


1 

i central  terms  are  asymptotically  mutually  independent. 


I 


Theorem  3.1.1.  Let  mT  , m^  , and  m,  be  nonnegative  integers  and 
m = m^  "’2  ^ "'3  ■ ^n^^  ’ increasing  rank  se- 

quences (k^  n - k^  ->•  “)  such  that,  for  some  integer  N > 1, 
k*-^^  < ...  < k^"^^  for  all  n > N,  :md  suppose 

1 ini  “*  9 , p — 1 , . . . ,m^  , 
n 

(ii'i 

k^  ^ 

1 im ^ ^ , M = 1 , • • • .m-,  , 

n m,+M  ’ ’ 2 ’ 

n 1 

where 


and 


0 < X ^.  < . . . < X„  . <1, 

nij+1 


llm 

n 


(m^+m,+p) 


= 1,  u =],...  ,m,  . 


Assume  also  that 


kOO 

X - lim  Y ^ 
M,v  „ ^ 


1 
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where  is  the  symmetric  m^^  x matrix  whose  (y,v)-th  component  is 

u 

X . 1 < u ^ V < m,  , is  the  symmetric  m,,  x matrix  whose 

y 9 V 1 z L L 

(y,v)-th  component  is 


mi+v^  mi+y' 


1 < y < V s 11I2  , and  Z^  is  the  symmetric  m^  x matrix 

(y,v)-th  component  is  Xf  j.,,  > 1 < y < v < m,  . 

^ m^+m2+y  ,mj^+m2+v  3 


wliose 


It  is  clear  that  we  may  alternatively  write  the  limiting  distribu- 
tion (3.1.2)  as 

^ ...  ,u  (X  ))  . (x^  p,  ...  , 

1 1 Z 1 

(nii+m,)  (m.+m2+l)  . ^ 

^^m^+m2+l^’  . . . ,u  (x^j^)), 


where  >I>_  is  the  zero-mean  multinormal  law  with  covariance  matrix  Z.  , 
j = 1,2,3. 


I’roof : Let  Xj , ...  ,x^  be  real  numbers  for  which  u^^-^  (x^)  is 

finite  for  each  y = 1,  ...  ,m  and  for  which  x^^  is  a continuity 

(m.+y)  "‘1  ^ 

point  of  C , y = 1 , . . . ,m2  . For  each  y = 1 , ...  ,m  let 

a^^^  > 0,  b*'^^  be  sucli  that  (3.1.1)  holds  for  all  continuity  points 


x of  . We  may  write 

,£<">  -b'" 


(1)  11 


— 9 • • • > 


;-(n)  , (m) 

\(m)  ■ % 
n 


(3.1.3) 


.p(x‘«(Xi)  sv<’>(Xj) xW(x^)  ^v<”)(xj). 


where 
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(M). 


= - I 


J n u n 


j=l  ^JiT) 


np;-(x„)<^W(x^) 


) = F(a^*^^x  + 

*^11  ^ p '•  n p n ■'  ’ 


and 


(x  ) = 1 - (x  ) , 

'n  ^ y'^  ^ y'^  ’ 

..  np^^^(x  )- 

^ /np'^^^Cx  )q*^^^(x  ) 

^n  ^ y^^n  ^ y'^ 


y = 1,  ...  ,m.  Since  we  will  assume  throughout  the  proof  that  x^ , ..., 
x^  are  fixed  real  numbers,  for  notational  simplicity  we  write 

’ p!,"’  . ''i"’  f” 

and  (x^)  respectively. 

From  (1.3.1b)  we  have  the  relation 


,(y)  _ n 


,(m)  ..(y), 


X 


) (1-^) 


AIT 


n 


(1  o(D), 


for  each  y = 1,  ...  ,m,  so  that 


and  moreover, 


np. 


(d)  ^ r(d) 

r\  * 


n n 


i.(d) 


(y)  1 n 

q ~ 1 - -~ 

^n  n 


since 


k(d)  (x  ) 


1 - 


d n 


"~k^ 

n 


(1+0(1)} 


^dT 


1 - 


/ k'^d)  ■ " 

= 1 - u^‘^^(x.)  / (1  + 0(1) ) - 1 


^ Vn(n-k^^^) 
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as  n -»■  «>.  llius  for  each  m = 1,  ...  ,m  we  have  that 
(3.1.4) 


n '• 


Now  according  to  the  well-known  Cramdr-Wold  theorem  for  conver- 
gence in  distribution  of  random  vectors,  the  relation 

xW)  .ar((x»> x<'“>) 

holds  if  and  only  if 

-iC{CiX»)  * ...  . 

for  all  real  c, , . . . ,c  . 

1 ’ m 

Ihus  let  c^,  ...  ,c^  be  given.  We  may  write 


say,  where 


c + ...  + c = I X . 
In  m n n,j 


I 


n,J 


I c 

t-  1 I 


t.  P - M J 


(b) 


p=l  ^ / (\T)  (ii) 


j = 1,  ...  ,n,  ;ind  where 


) = a^^^x  + b^^^)  , 

n n Mr  n m n ’ 


M = 1, 


,m. 


Consider  the  array  l<j<n  ’ Clearly  the  r.v.'s  X^ 

•••  »^n  n independent,  since  the  M are  independent,  and  also 
1 1 y 1 1 n 

ys 

hXn  j “ ^ ‘*11  **>j-  Additionally, 
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nVarX^.j  • cj  ♦ ...  • 

[e  I ,W1 

+ 2 y c c ^ 2 

l^u<v^  ^ / (yTJy)^(v)  fv) 

l,(y)  n n n % 

Since  2 — ^ y^e  niay  suppose  for  all  sufficiently 

large  n that  for  y < v,  and  thus 


‘-^1  n ’ n -* 


Therefore 


n Var  X . = c^  + . . . + c“  + 2 y c c 
n,j  1 m , '“li'" 

l<u<v<m 


(y)  (v) 

pV.K./pV.  J 

^n  ^n 

^n  ^n  ‘^n  ^n 


(a.  1,5)  -►  c,  + . . . + c +2  y c c a 

1 m ^ y V u,\ 

l<p<v:£m 


as  n ->■  °o,  where 


p(y)^v) 

a = lim  I 2 ,.  y-  Y , 
^n  *^n 


1 < U < V < m.  Also,  since 


(y)^(y)  _ n '■  n 


n '■  n 


np  q 
' n 'n 


it  is  clear  that  the  r.v.'s  X , , . . . ,X  are  uniformly  bounded  in 

n,l  n,n  ‘ 

j = 1,  ...  ,n  by  a numerical  quantity  tending  to  zero  as  n so 

that  the  array  {X  -}  satisfies  the  Lindeberg  condition 
» J 


= 0 for  every  e > 0. 


ITius  by  the  usual  central  limit  theorem  for  row  sums  from  triangular 

arrays  (Lodve  (1963,  p.  295)  ),  we  have  that  + ...  + = 

n 

y X . is  asymptotically  normal  with  mean  zero  and  variance  the 
j=l 

limiting  quantity  (3.1.5).  lliat  is,  equivalently. 
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<^(c  + ...  + c 

In  m n ■'  1 


m -’ 


where  the  X^^^  are  standard  normal  r.v.'s  with  correlations 

h = 0 , 

M,V 

1 < a < V < m.  Hence  by  the  Cramdr-Wold  device, 


(3.1.6)  a:((  xW,  ...  ,xW)l  .Xf(x« x<'">) 


whore  the  random  vector  (X  ■■■  ,X^”'h  has  the  zero-mean  m-dijiien- 
sional  normal  distribution  4>j,  having  as  covariance  the  m x m sym- 
metric matrix  E whose  (a,v)-th  component  is  .^  > 1 s P < v < m, 

and  wliich  has  units  on  its  principal  diagonal.  ITius  combining  (.i.1.3), 
(.3.1.4),  and  (3.1.b)  we  obtain 

fCW,  -b'"" 

fpi)  n 

nl  n 

~7W 


^(nJ  b^"‘^ 

\(m)  n 
n 


n ^n 


< X 

m 


Final ly  let  us  evaluate  the  components 

%,v  ■ (v)  • 

’ n V p 


‘n  ‘ n 


.(M) 


i.(v) 


(i)  If  - V 0 <'md  _ > 0 that  is,  1 < p < v s m,  , then 
n n > t-  ^ 

cT^  = lim  » which  we  assume  to  exist. 


n i/  k 


k 


.fp) 


.(V) 


(Li)  If  — ->0  and  >■  A,  0 < A < 1,  then  clearly  a = 0, 

^ n n ’ ’ •'  p,v  ’ 

since  p^^^  ->■  0 and  p^^^  -*■  A. 

* n * n 


i.(p) 


.(P) 


(iii)  If 


A and  -d- 
P n 


-♦•A  , 0<A  sA  <1,  then 

V p V 
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I \i  V 

%.v  V ’ 

ktu) 

( i\0  I f — — ->  X , 0 < X < 1 , and  >•  1 , then  o = 0 , 

^ n M y n ’ M,v  ’ 

since  ->  0. 

k(M)  k^^^  1^^ 

(v)  If  ->  1 and  ^1,  M < V,  then  ^ = lim 

lini  / 5-y  , assumed  to  exist. 


n -V  n-k 


Hence  from  (i)-(v)  the  components  of  the  covariance  matrix  E are  as 
claimed  in  the  statement  of  the  theorem.  It  is  worth  noting  that  the 
components  do  not  depend  upon  x^  ...  ,x^^  . 

For  a particular  type  of  the  intennediate  rjink  sequences  consid- 
ered, ive  have  the  following  result  as  a special  case  of  the  previous 
theorem . 


Iheorcm  3.1.2.  .Suppose  is  a given  intermediate  rank  sequence  :ind 

is  i.i.d.  with  marginal  d.f.  F belonging  to  the  domain  of  attrac- 
tion for  smallest  terms  of  the  law  (x)  = <I>(u^^^(x))  for  each  of 

the  intermediate  rank  sequences  k^^^  defined  by 

k^^^  = maxll,  [tk^]}, 


for  0 < t < 1;  that  is,  tliere  arc  real  sequences  a^^^  > 0,  h^^^ 


such  that 


k^t)  n 


< X ->■  (xi 


for  all  real  x,  for  each  0 < t < 1.  Tlien  for  each  choice  of 

0 < t^  < ...  < tm  ^ 1, 
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(nj 


^ (t,)  n 
k ^ 

II 


Tt7r 


(n)  . 


< X 

- A,  , ...  , 


n 


for  all  real 


(tJ  (t  ) 

->  4>j,(u  ^ (x^),  ...  ,u  ^ (xj) 

,x^^^  , where  is  the  zero-mean  m- dimensional 


noniuil  law  witli  covariance  matrix  Z wliose  Cu,v)-th  component  is 

IT' 

I ^ , 1 < M < V < m.  Tluis  if  a sequence  of  stochastic  processes 

'■y 

{Vj^(t) , is  defined  by 

d"'  - i,('J 

i,(t)  t, 

n 

“TTtl  ’ 


V [tj 


/t 


0 < t < 1 
t = 0 


then  for  anv  0 < t.  < . . . < t < 1 , 
1 m 


...  ,Yj^(tj] 


A 

Z'  ’ 


where  <1^,  is  the  zero-mean  m-dimensional  normal  law  with  covariance 
matrix  Z'  Vv/hose  (vi.vj-th  comjionent  is  t^  , 1 < p < v < m;  that  is, 
the  finite-dimensional  distributions  of  converge  to  those  of  the 
(standard)  Weiner  process  on  the  unit  interval.  (See  Section  S.2.) 


It  is  evident  that  the  method  used  in  the  proof  of  Theorem  3.1.1 
does  not  specifically  require  the  attraction  of  the  marginal  d.f.  F 
to  the  one -dimensional  limit  law  for  each  of  the  increasing  rank  se- 
quences being  considered,  but  only  that  appropriate  u^  levels  c.an  be 
chosen,  that  is,  to  satisfy  (1.3.5),  (1.3.10),  and  (1.3.11).  lluis  upon 
rephrasing  the  proof  of  Theorem  3.1.1  we  can  show  the  following  result. 
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which  includes  as  a particular  case  the  fonnulation  and  solution  of  the 
multi-level  exceedance  problem  relevant  to  intermediate  and  central 
nink  sequences. 


llieorem  3.1.3.  Let 


m^  , m2  , and  m^  be  nonnegative  integers  and 
m - m^  + 1112  + m^  . Let  , ...  ,k^‘”^  be  m increasing  rank  se- 
quences such  that  for  some  integer  N > 1 k^^^  < < 

(m,+m,+n  s K„  and 


whe  re 


n > N,  and  suppose 


k(v0 

‘r  ■ “ 


k 

l im  -il 
n 


(mj^+u) 


= A 


nij^+U  ’ 


M 1 j • . • ^m^  , 


M = 1,  ...  ,m-  , 


iuid 


0 < A < 

m^+] 


< A ^ < 1, 

m^^niz 


(m  +m.+u) 
k ^ ^ 

I in.  - ” 
n 


n 


- 0.  M = 1 , 


’"’3  • 


Sup[X)se  also  that 


1,(10 

A = lim 
M.v  „ 


exists  for  each  1 < g < v < m^  , and  that 


k 


(mj+m,+v) 


\i^+m2+u,mj+m2+v  ~ ' (’m^+niz+ij) 

k 

n 


exists  for  each  1 <:  u < v < m^  . Let  be  i.i.d.  with  marginal 


il.f.  r.  Let 


u 


(i: 


(m)  , 

,u  be  real  numi.ers,  and  suppose  for 


b = ( , ...  ,m,  , tlic  level  u^'''^ 
1 n 


is  such  that 


A 


^ n J „ n 

^uppose  oi  u - 1,  ...  ,ni2  , the  level  u is  such  that 


(nii+u)  ^^"'l 


1 - = -iL 


(m,  +u) 


iitj+y^  inj+vi 


+ o — 


also  suppose  (or  y = 1,  ...  , u^  ^ ^ 


(m,+m^+y)  (m,+m^+y)  j~ (m,+m„+yl 

(m^.„,2^yj]  __  ^ ^ ^ K 


(nij  +irT^^ 


Now  let  = 7 I 


. r ful  number  of  exceedances  of  u 

1 = 1 ^ 1 
•in  Cm  a-m  +i . ^ 


'■’y  '.j.  •••  ,f.  , lor  y = 1,  ...  ,m, +m,  , and  let  T 

ii]  V <,,  "i“’'t>cr  of  which 

i J j i n 

(mj+m-,+y) 

" , for  y = 1,  ...  ,m,.  . Then 

y = 1 ni  • 

n n ’ ^ I , . . . , 


(mJ•^m2+y) 


do  not  exceed 


fm,+y)  (m, +yl 

l\’  ‘ < k ^ 

n n 


fm^+m,+y)  (mj+m,+y) 


» b 1)...  , m2 ) 


^ k^  . y - 1 , . . . .ni^J 

'fy  (u'  , ...  ,u  ' ) • 'ty  (u  ^ 

1 ^7 


(m, +m,J 
’ - ) 


fm  +iii,+l) 

$y  (U 


. ...  .u'"’^) 


as  n -*■  ■»,  whole  for  j l,2,.s,  <j>  is  the  zero-mean  m. -dimensional 

j ^ 

noniuil  law  with  (s>’mmetric)  covari^mcc  matrix  , respectively  given 
by 


^■1  = ), 

1 '■  y .vMsysv'-in, 
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= 


^ . (i-A  . 

^m^+v  ^nij^+y^-' 


ami 


l<Vi<v<m- 


**'V”2*>*’"‘l*'"2*'’\<psv<n,, 


We  conclude  this  section  by  stating,  in  our  notation,  the  follow- 
ing result  of  Qien  (1966,  Leinma  9),  which  gives  the  limiting  joint 
distribution  of  fixed  rank  and  increasing  rank  order  statistics,  when 
the  one -dimensional  limiting  distributions  exist.  As  is  evident  these 
are  asymptotically  mutually  independent,  and  combining  this  result  with 
Theorem  3.1.1  we  liave  the  asymptotic  mutual  independence  of  order 
statistics  of  the  five  rank  classes  fixed  largest,  largest  intermediate, 
central,  smallest  intermediate,  and  fixed  smallest.  Moreover,  we  have 
the  asymptotic  mutual  independence  of  the  numbers  of  e.xceedances  of  the 
levels  u^^  defined  by  (1.2.101,  (1.3.5),  and  (1.3.11),  when  the  imirgin- 
al  d.f.  I'  of  the  sequence  is  such  that  these  levels  can  be  so 
chosen . 


ITieorem  5.1.4.  Let  , m2  , and  m^  be  nonnegative  integers  c) 


;ind 


m = m.  + m^  + m,  . For  each  n = 1 , ...  ,m  and  each  n > 1 let  W 

1 2 a t 

be  a sum  of  n i.i.d.  indicator  r.v.'s  such  that 


(m) 


n 


(m  +m2)  (m,+m,+l)  . . 

< W ^ < n - W ^ “ < . . . s n - 

n n n 


Suppose,  as  n 


,(1) 


(m.) 

k, , ...  ,W  ^ = k 

1 ’ ’ n m 


p 


1 , = k, , ...  ,I  = k 

1 r ’ mj  nij 


for  any  nonnegative  integers  k, , ...  ,k  , where  (l,,  ...  ) is 

I ^ 1. 

an  independent  increment  Poisson  vector;  suppose 
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(m,+l)  (m,+l) 

W,  -BV^  _ (m^n) 


rfviT~ " 

2i.r  i 


Var 


(nu+l) 

for  all  real  u , . . . ,u 

normal  law;  also  suppose  that 


(m,+m^)  (m,+m,) 

‘'n  ■'-'"n 


-►  A 

Z 

(m^+m2) 


Var'-^ 

r 

(m^+1) 


,u 


(nij+m2) 


, where  <J>j,  is  an  m2-diniensional 


W 


(mj^+m2+l) 


■ "i"’  ■ VJ 

^ 

for  any  nonnegative  integers  fk  + , , ...  ,k  ) , where 


(•J 

Hicn 


mj^+m2+l ' 


n,l+,„2+i  > •••  is  a reverse  independent  increment  Poisson  vector. 


I’ky’  = k. , ...  = k ; 

n 1 ’ ’ n m, 


fm,+l)  (m,+l) 

\ -l\  fni^+1) 

r(m.+l)  “ 

Var"W  ^ 
n 


Cm,+m~)  (m,+m,) 

Var%  ^ 
n 


(m,+m^+l) 

n m^+m2+l  ’ ‘ ' ’ V V 

. , (in,+l)  (m,+m,) 

P(il=l<l,  ...  • \[u  , ...  ,u 

^ ^'^mj+m2+l'‘’^mj+m2+r  ■'■ 


) 


as  n ->■  0°,  for  all  nonnegative  integers  k, , . . . ,k  , k 

* 1 m. ’ m,+m,+l ’ 


kj^  , and  for  all  real  u 


fnij+n 


,u 


fmj+ni2) 


"1  '"1  '"2 
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3.2.  The  Stationary  Case. 


In  this  section  we  give  one  set  of  conditions  under  which  ’■esults 
of  tlie  previous  section  are  valid  for  stationary,  dependent  sequences 
. These  conditions  are  similar  to  those  used  in  Section  2.3  for  the 
one -dimensional  limiting  distribution  and  single-level  exceedance 
problems,  though  somewhat  more  complicated  due  to  the  consideration  of 
several  rank  sequences  simultaneously,  and  therefore  we  deal  exclusive- 
ly with  intermediate  order  statistics. 

To  briefly  describe  the  results  to  be  obtained,  we  will  give 


conditions  under  which  the  random  vector 


(n) 

v(i)’  •• 


(n) 

.(m)J 


nor- 


n n 

malized,  has  the  same  asymptotic  distribution  as  it  would  if  the  sta- 
tionary sequence  ^ were  actually  independent,  where  we  assume  the 


random  vector  ^ 


:(n) 


.(1)’ 


,5 


(n) 


.(m)J 


tion,  being  the  independent  sequence  associated  with 


indeed  has  an  asymptotic  distribu- 

In 

fact,  we  will  find  it  convenient  to  work  directly  with  the  more  general 
multi-level  exceedance  problem  developed  for  i.i.d.  sequences  in 
Tlieorem  3.1.3,  where  we  restrict  consideration  to  u levels  deter- 
mined  by  intermediate  rank  sequences. 

Throughout  this  section  we  assume  that  is  stationary  with 

marginal  d.f.  F.  Let  ni^  and  m^  be  nonnegative  integers  and 


m = m^  + m2  . 


Suppose  that  k, 


(1) 


(m) 


ate  rank  sequences  such  that 

.0)  . 


(3.2.1)  k 


(m.)  (nu  + 1) 

. s k and  k 
n n 


are  m given  intermedi- 


.(m) 


for  all  sufficiently  large  n.  For  our  purposes  we  define 

V C,,') 

k = max{k^  , Isp^ml 
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and 


As  in  the  one-dimensional  problem  considered  in  Qiapter  I [ , we 

construct  the  following  partition  of  the  first  n positive  integers, 

for  each  large  n:  Two  given  sequences  of  integers  and 

<■  «>  such  that  = o(n)  and  B^^  = determine  intervals 

...  of  respective  lengths  a ,B„,  ...  ,a  ,y_  , where 

^ n n n n 

n = (a^  + and  0 < 2B^^  , iind  moreover, 

~ na^^  . Now  let  , ...  be  m real  sequences. 


k‘V>.  ■ I I 


j.iw 


(u)n  • 1 s i s , 1 < „ s mj  , 


;md 


X^-d)  = Y I 


1 < i < 2iL^  , m^+l  < u ^ m. 


.Also  define 


a;ao  = 


Var  , 1 < y < m 


(n) 


1 


Var  , m,  + l < n <;  m 

r(n)  ’ 1 

1 


We  consider  the  following  assumption: 

J:  llicre  is  a sequence  of  integers  and  = o(*^) 

such  that 


n' 


J 
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(3.2.2)  c-l  - j)(p(Cj  > u<“),  > uM) 

• f(5l  > '4''’.  £i»j  > u'***)  - 2(1  - F(u^">))(l  - F(u<'’>)j 


= o 


for  each  1 < < v < , 

a_-l 


(3.2.3)  a-‘  (0.^  - j){p(£j  .uM,  Ei,j  * uM) 


* '’(Si  ^ S]^J  5 u;<''))  . 2F(uM)F(u<“>)} 

.(W. 


= o 


n 


for  each  iiij^+1  < p < v ^ m,  and 


a -1 


(3.2. 


^ ^ - 2(1  - F(u^^^}]F(uf^^)} 


= 0 


r/kW^, 

n n 


for  each  lsp<m^<v<m;  and, 


For  some  for  which  (5.2.2) - (3.2.4)  hold,  there  is  a sequence 

V 

of  integers  2^.^  -»■  “>,  > ‘"iriJ  3^^k^  = o(n),  such  that 


(3.2.5) 

where 


n 


^ i o 


g = sup  sup  (P(AB)  - P(A)P(B)|, 

" l<s<2il  -1  A<J^ 

n ^n,s 

n , j 


,S+i 


g being  the  a-field  generated  by  the  r.v.'s 


Ill 


m. 

I I tM  , i., a 

U=1  l'  ^ M=m,+1  n"''  J 

1 1 1 


;md  the  a-field  generated  by  the  r.v.'s 


m. 

{ y + y i = 

V=1  l-'^^  |j=mi+l  1."^ 


s+2,  ...  ,2lJ. 


1 " 1 


Cori'csponding  to  (2.3.4)  in  the  one -dimensional  problem,  a condi- 
tion stronger  than  (3.2.5)  in  that  more  events  must  be  considered,  is 


(3.2.6) 


where 


— h (S  ) ->  0, 
a n ^ n 
n 


h (n  = sup  sup  |P(AR)  - P(A)P(R)|, 

l<s<n-«,  At^' 

"n , s 

being  the  o-i'ield  generated  by  the  collection 

II  , lr» 


I . , u = 1 , . . . ,m.  , i = 1,  . . . ,s  ; 

1 n 


1 n 


, u = m +1,  . . . ,m,  i = 1 , . . . ,s 


and  s+ii+1  generated  by 

^ , p = 1,  ...  ,m  , i = s+J+1,  ...  ,n  ; 

*•  [C->iJ  1 
n ^ 

I fu)  ’ ^ ^ ...  ,m,  i = s+Jl+1,  ...  ,ni. 


Su])pi)se  that  for  large  n we  )iavc  u^^^  > if  1 < p < v s m. 

Define  intervals  on  the  real  line  by 


G = (u  , «■]  , 
n,o  '■  n ’ ■' 
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and 


''n.p  ‘ 


^ = (-00, 
n,m  ^ ’ n 


'Hien,  equivalently,  is  generated  by  the  r.v. 's 

n,  s 

Urr  ,G  1 ’ V = 0,  1,  ...  ,m,  i = 1,  ...  ,s) 
n,u  ■' 

{Ir^  Q -I,  U“0,  1,  ...,m,  i“  s+3_'*'l , • • • ,n} . 

n,q-^ 

Now  for  fixed  n,  s let  y'  = {gj,  ...  .y^}  be  a finite  sequence  of 
length  s ;ind  y"  = (y  ^.n  +i  > •••  .y„)  a sequence  of  length 
n - - s - 1,  both  of  whose  components  are  the  integers  0,  1,  ...  ,m. 

Define  events 


and 


^ ^'n,yj^  ’ ^ 1,  ...  ,s) 

V’  " ^ ^n,yj^  ’ ••• 


It  is  not  difficult  to  see  that  each  ^ ^ 5 is  some  disjoint  union 

of  at  most  (m  + 1)^  events  each  of  the  form  A , , and  similarly  each 


n-s-3 


B 


s+S  +1  ^ disjoint  imion  of  at  most  (m  + 1)  ” events  of 

^ n 

the  form  . Hence  a sufficient  condition  for  (3.2.6)  is 
(3.2.7)  sup  sup  |P(A.B,,,)  - P(A  . )P(B,,,)  | = ofc  (m  + 1)"1 


l<s<n-3^  y ' ,y" 


y y 


J 


However  we  will  work  directly  with  the  assumption  J as  stated  in 
deriving  our  main  result  below. 


Theorem  3.2.1.  Let  be  a stationary  sequence  with  marginal  d.f. 


r 


11.3 


F.  Let  ...  be  m = in,  + hIt  intermediate  rank  sequences 

n ’ ’ n 12  , , ^ 

k(M) 

satisfying  (3.2.1)  and  assume  that  A = lim  — v-  exists  for  each 

k(v)  n 

1 < u < V < m,  , and  that  A = lim  exists  for  each 

n 


nij+l  < u V < m.  Given  real  numbers  u*-^-*,  ...  , suppose  for 


M = 1 , ...  ,m^  , the 


level  u^^^  is  such  that 
n 


^,(h) 

(lOi  _ n _ n JL  _ + o 


1 - F(u^>'J)  = ^ 

n •'  n 


n 


and  for  p = iiij^+l,  ...  ,m,  the  level  such  that 


'-11''  n 


k(u)  ,,(F) 


n 


+ 0 


n 


Let  W 


i=I  [f.>u^^^] 
1 n 


^ y I , , be  the  number  of  e.xceedances  of  u^^^  bv 
^ . 1 1 1 1 - n 


n 


...  , for  1 < p < m^  , and  let  = I I 


1=1 


be  the 


number  of  ...  which  do  not  e.xceed  u^^^  , for  m^^+l  < p < m 

Then  if  the  assumiJtion  ---  r..(D 


.1  liolds  for  the  set  of  sequences  (ir^  , •••  , 


u^"'^),  we  have 


< k[^“^  , P = 1,  ...  ,in^  ; > k^^^  , p = m^+l m) 

r (1)  . r On)i 

^ [u'-  -',...  ,u  ) • 4)^  [u  , . . . .ir  J 


as  n ->■  where  for  j = 1,2  , is  the  zero-mean  m- -dimensional 

j ^ 

normal  law  with  covariance  matrix  given  by,  respectively. 


and 


F 
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(3.2.9) 


^2  +11  TYi  +\i^ 


nij^+Vi  ,m^+V''  l<y<vai2 


Proof:  Let  and  3^^  be  given  sequences  for  which  the  requirements 

of  assumption  J are  satisfied.  We  have 

u = 1,  ...  ,m^  ; m = m^+1,  ...  ,m) 

= < v^'^\  y = 1,  ...  > v^^^ , y = m^+l,  ...  ,m) 


where 


and 


f W^^^-np(^^ 
' ji ^n 

. I °n^^^ 

r(y)  _ 

“ 1 

TCy)  (y) 

- np^ 

n ^n 

I /^On(y) 

. s - np^^^ 

,(y)  _ n ^n 


/r  a^(y) 


r 1 - f(u^^^) 


y — 1 , ...  ,m-| 


y = m^+1,  ...  ,m 


y = 1,  ...  ,m, 


y = 1 , ...  ,m-| 


y = m^+1 , ...  ,m 


.(F) 


For  each  y = 1,  ...  ,m  we  have  p^^^^  0 and 


(3.2.10) 


np. 


(y)  ^ . 


Hence  by  stationarity  and  (3.2.2),  for  y = 1, 


,m. 
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a (l 
ir  n '■ 


a 

n n 

n 


a -1 

1-'"^)  * 2 - j,(p(5j  > uM.  > u(")) 


1 - 

'•  n -’ 


iuid  similar  I >■  also  by  (3.2.31  we  in  fact  have 


13.2.111 


a k 


.(Ul 


a (ul 

n ^ 


tor  each  p - 1,  ...  ,r,\.  Therefore,  from  (3.2.101  ;md  (3.2.11)  it 
follows  that 


(3.2.121 


,.U0  . , 
n 


, M = 1 , . . . ,m 


1 


*'ul 

( 'u''  , u = ni|  + l,  ...  ,m 


Lot  Cj,  ...  ,c^^  be  real  numbers  and  write 

2£ 


•••  ^ C = y X . , 

In  111  n j ^ 2 n , ] 


(m)  _ 


where 


■Si  i = ^ 

M=1 


-jfnl 

i 

c 


(nl 


m 

- I 


v'^  o (yl 
n n^^ 

'['(pl  l;  'T'(p) 

j(nl  ^-‘,(01 


U=mj  + 1 Oj^(p1 


1 f we  can  show  tliat 
(3 


.2.13)  lim  y i;X“  • = y c^  + 2 Y c c X' 
n i odd  p=l  l-.p<i-m  ‘‘  ^ 


1 


+ 2 


I c c X 

1 I \i 


m^  + lsvKvam 


p V p,v  ’ 
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(3.2.14)  lim  I eP  . = 0, 

n 1 even  ’ 

and 

2£n 

(3.2.15)  lim  E(X“^.  Ij-|^  = 0 for  all  c > 0, 

t±ien  since  the  a-fields  ^ and  ^ clearly  are  also  generated  by 

ther.v.’s  ...  and  •••  >^n,n  ' respectively,  it 

U 

n 

will  follow  from  Lemma  2.3.1  that  I X ■ is  asymptotically  normal 

i=l 

with  mean  zero  and  variance  the  limiting  quiintity  in  (3.2.13).  Then  by 
the  Cramdr-Wold  device  and  (3.2.12),  the  statement  of  the  theorem  will 
be  immediate. 


We  first  liave 

O 

ni  c*" 

EX‘^  . = I 
n,i  £ 

p=l  n 


“ l.p<L^  ' l{n)Jl 


(3.2.16) 


c c 

+ 2 y ^ ^ E 

m^n<i<v<m 


I 


I 


(n) 


(n) 


+ 7 


Uv4v^  nrijn)  ■ -')Mj  IS'W 


c c 

P V 


- EW^4^1 


1 

j(v ) 


. (v)  1 

‘•‘T(n) 


say.  Now  for  large  n,  if  p s v,  so  that  for  fixed 


1 < p < V < in 


i 


r(n) 


1 ’ 


- EW 


(U)  1 

(n) 


\(n) 


EK 


;(V)  1 

(n) 


a 

((  " 

= E-{  y I /-  -I  - p 

Uj=i  rr 


(P) 


n 


n 

y 1 cm'i  - a p 


(V) 
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- a2p(^^)pMl 
n^n  ^n  J 


j^k 


X p^*^^  fl  - p^^^) 
n^n  '■  Ml  ■' 

a.-l 


9 (U)  (V) 

- 2 p p 


a 

p n 

n 


1))'  stationarity , [3.2.21,  and  (3.2.10).  Hence  by  (3.2.11), 


(3.2.17)  ->2  I c c , 


l<p<v<m 


M V u,v 


1 


Similarly,  using  (3.2.3),  (3.2.10),  ;md  (3.2.11),  we  obtain 
(3.2.18)  il  a1”^  - 2 y c c a'"  . 

n.5  ^ ^ pvij,v 

ni^  + lSp<vaii  ’ 

Also,  for  1 < p < iii-j^  < V < m and  for  large  n, 

‘^trj(n)  '-''.(nlJi*  (n)  ''‘,(n)J/ 

i 1 * 1 * 1 it 


n 

y T r 1 ■ P 

i = l [f.>uf^^] 

J n 


ooli  j"  , 


kU  ■ V" 


2Ju)„(v) 


= Hi  y 1 , - a 

’ n '■  "j  n ’ ’k  n -' 


j^k 

a - 1 

"l  («n  - 
j = l 


'1  n 1+j  n 


F f .. 

M n ’ "1+j 


(V) 


.>u'"’l  - 2p^>^^p^^H  ^ (X 
] n J ' n ' n I ir  n ' n 
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by  (3.2.4), 
(3.2.19) 


^ n * 


n‘  n ‘ n 


and  thus  from  (3.2.10)  and  (3.2.11), 


i ->  0. 
n 4 


Upon  combining  (3.2.16)  - (3.2.19)  and  using  stationarity  we  obtain 
(3.2.13) . 


Next  we  have , assuming  > 1 , 


Var  W 


,(m) 


HI?  ^ = I 


(n) 


Var  T 


•(b) 


m 


2 Y 2 

+ I 


I 


(n) 


M=1  Vn<^^^ 


c c 

+ 2 y Mb 

li')j<vsmj 


r(n) 
2 


i(n) 
^ 0 


- Hw^y\ 

, r(n)  j(n) 

2 ^2 


I 


c c 
M V 


a a (m)o  (g) 


m-^+l<u<v<m  "n'"n'''^^n 


'(m)  _ p'j'(y) 


(n) 


(n) 


b)  . r f (v) 
(n)  ^'^(n) 


I 


+ 2 


I 


c c 
M b 


l<U'imj<v;:m  h n 


£ a (y)a  (v) 

in  r\  T-^v.  j 


2 4 

rr 

E 


j(n) 


T ( b)  _ (.,•  T-  ( v) 

I i(n)  (n) 

i. 


(3.2.20)  = + B^"^  + B^^"^  + B^'"^ 


I 


(n) 

2 


say.  We  may  show  that 


Var  W 


(U) 

1 (n) 
2 


0, 


M = 1 IIIj  , 


r 


n<) 


;ind 


Vai-  r 


• ClO 


tnj 


o"(m) 

n 


U = m^+1, 


,m, 


using  the  s;uiie  calculations  as  in  the  proof  of  Lemiiia  2.5.1,  and  we  omit 
the  details.  Hence 


n{"'  . o 


ami  ig"’  = o 


Now,  we  have  for  1 < p < v < , ;uid  n large, 


i(n)  ,(n)J 

I -)  I ^ 


j(n)  Vn) 


(5.2.21) 


I 1’ 


3„-l 


(V) 


n*  n ‘ n 


- * "l  («„  - j){r 

1=1  ^ 


1 n 


f,i>U.  , s 


l + i '^n  j 


+ P 


^l  n ’ "l  + i n 


(P) 


■)  (p)  Iv) 
2r>  p ' 

' n ‘ n 


by  stationarity.  llien. 


I I - jH'' 


.i=l 


f.,>u*^‘\  f,i  .>u*^'^’i 

1 n M+j  n J 


+ 1> 


1 11.  ’ ^1+j  n 


i’l  n ’ " 


i=u  -B  +1 
n n 


j - (u  - 6 ) 
n n 


fv) 


+ I' 


' 1 n a - I + 1 n 

' n ■ 


(P) 


r 


ft 
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B„  “n-> 


n j=l  ” I I-  ^ J 


,(v) 


, (m)  (v)1 

2 p p 

* n * n J 


+ y? — — a (a  - l)p^^^p^^^ 


+ 2 


a -B  a 

a n n 


o a -1 
3 > a 

.1^  (%  - j)^’ 


1 a ’ ^1+1  a 


+ P 


5P'4”’. 


- 2 

^ a ‘a 


(3.2.22)  = c{'^’  + , 

I 2 0 


say.  By  (3.2.4)  we  have  that 


(3.2.23) 


C<"'  . o 


a a 


Also,  it  is  easily  seea  that 


(3.2.24) 


= o 


3.,k 


(M) 


a a 


Moreover, 


(3.2.25)  C 


fni  ^n“n  k 

(a)  a a a a _ 

2 ~ 2 ’ 2 ° 
a 


a a 


a 


siace  S k = o(a) 
a a 


Ilius  from  (3.2.20)  - (3.2.25)  it  follows  that 


= o 


fl 


I 

A 
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We  may  also  show  that  = 1_]  and  = fl 


4 = ^_j  in  virtually  the 

siuiie  manner,  and  we  omit  these  details.  Therefore' by  stationari ty. 


(3.2.26) 


• ^ ^-^n  i = ■ - 

1 even  ^ n,i 


We  now  separately  consider  P,  X 


n,2£  • 

n 


^“,2£  = + pCn) 

II  ^ “ ■’  4 5 

a.,  defined  by  (.'>.2.20),  now  replacing  the  interval  by  I 

It  is  clear  tliat 


2£  • 
n 


U = 1, 


• >^'2  > 


\ar  • ( ( + 28  (l 

j(n)  'n  (I  - Pn  J . U = m2+l,  . 


a-,  that  by  (3.2.10)  .-.nd  (3.2.11)  and  £ . 

n 


W|  •’■  (1  and  V 0. 


Mso,  for 


il  - V ■-  111, 


1 l”)J  i ,(n)  ‘-".(n) 

21  *2£  '2£ 

" n n 


1 ■ j ,k''w  +28  ( J ^ k n j 

n * n 


S ('■„  * 2e„)’p‘"'  • 


•ml  since  S„  - o(e„l  a,  - o( /kj  , „hicl,  iniplies  P = o(n).  i, 
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follows  from  (5.2.11)  that  ->■  0.  Similarly  ->  0 and 

(n) 

B^  ->•  0.  Iherefore  liX“  ^ ->  0,  which  along  with  (3.2.26)  gives 

’ n 

(3.2.14). 


Finally,  |X^  J is  bounded  by  a numerical  qu.'intity  , wlicre 


K = 0 
n 


whicli  tends  to  zero,  so  that  (5.2.15)  holds,  lliis  completes  the  proof. 

-%  an  immediate  corollary’  of  this  result  we  may  in  the  obvious  way 
obtain  the  following  theorem  giving  the  asymptotic  joint  distribution 
of  several  intemediate  order  statistics  from  the  stationary  sequence 


llieorem  3.2.2.  Let  be  stationaiy  with  marginal  d.f.  F and 

^ fl1  ("hi 

associated  independent  sequence  , ;md  let  , ...  ,k^  , 

(nii+1) 

kj^  , ,k^  ^ be  m intemediate  rank  sequences  satisfying 

kt^) 

(3.2.1)  and  such  that  A = lim  -5— r exists  for  1 < p ^ v < m,  and 

M,v  j^(v)  1 

y - lim  exists  for  m^+1  < p < v < ni.  Suppose  there  arc 

n k 

n 

constants  > 0,  such  that,  as  n 


^:(n)_b(M) 


kut- 

P 


< X G (x)  = <5>(u^’^  (x)] 


for  all  real  x,  for  each  p = 1,  ...  .iiij  , and 


12.3 


,4n)  (m) 

n 
n 


rTui 


< X 


for  all  real  x,  for  each  p = m^+1,  ...  ,m.  Then  if  ,J  holds  for  the 

set  of  sequences  , ...  where  for 

n n II  n n 


all  real  , ...  ,x^^^  for  which  each 
lently,  for  which  0 < (x^^)  < 1,  tlien 


is  finite,  or  equiva- 


,fn)  , (nl 
n 


.TuT^ 


^ X M = 1,  ...  ,m. 


■Cn)  u(lO 
v(;i)  ■% 

II 

—jrr  - ' 

n 


M = nij  + 1, 


(m, ) 

,u  ^ (x  ' 
'■  ni.  •' 


(nh  + 1) 
u (X 


iitj^+l 


> 


as  n where  <J)  and  <1>  are  the  zero-mean  multinomial  laws 
'^1  ^'2 

with  respect iv^e  covariance  matrices  {tiven  hy  (.3.2.8)  and  (3.2.9).  iliat 


f 


is,  the  random  v^ector 


ni' 


-(111 


-(n)  _(n) 


■■■  ’ (m.+l) 

K ^ 

n n 


, ••• 


(n) 

r('n) 


^n  ■ 

has  the  same  limiting  distribution,  and  under  the  same  nomual  ization. 


as  the  riuidom  vector 


,(n 


(n) 


■■■  ’ (mj 

k ‘ 
n 


^(n),  ^(n) 


l,(m,+l) 

^n 


, ... 


(n) 

1.  ("i) 


(For  each  component  of  these  random  vectors,  the  appropriate  nomial iza- 
tion is  tliat  for  the  corresponding  one -dimensional  limiting  tlistribu- 
t ion . ) 
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For  stationary  normal  sequences  we  have  found  it  possible  to 

formulate  conditions  on  the  covariances  r = , sufficient  for 

n 1 1 

the  assumption  J to  hold,  lliis  may  be  done  by  first  establishing  a 

more  general  form  of  Lemmas  2.4.1  and  2.4.2  involving  different  "u" 

levels,  and  working  directly  with  the  mixing  condition  (3.2.7),  the 

m-dimensional  analogue  of  (2.3.6)  used  in  the  one-dimensional  case. 

'lliis  latter  of  course  would  lead  to  our  again  assuming  the  covariimcc 

sequence  r^  tends  to  zero  exponentially.  However,  the  calculations 

are  rather  complicated  and  moreover,  unfortunately  involve  nuiking 

further  restrictions  upon  the  several  intennediatc  rank  sequences 

considered,  as  well  as  upon  6 = sip  )r  j.  Because  of  this  somewliat 

n>l 

unappealing  situation  we  will  not  present  this  development  here. 


CHAPTER  IV 


i 

REPRESENTATIONS  OF  INTERMEDIATE  ORDER  STATISTICS 


4.1.  Introduction:  The  Bahadur  Representation  of  Sample  Quantiles. 

For  a fixed  number  X in  the  unit  interval  (0,1)  let  F be  a 
distribution  having  a unique  X-quantile  such  that  F(Xp^)  = A.  In 
fact  suppose  that  in  some  neighborhood  ^ ^ contin- 
uous derivative  F'  such  that  ^ 0.  Then,  as  we  have  noted  in 

Section  1.3,  F belongs  to  the  domain  of  attraction  of  the  standard 

k 

normal  law  for  any  sequence  of  smallest  ranks  for  which  pp 

or  equivalently,  for  any  sequence  k of  largest  ranks  for  which 

n-k  +1  " 

n <> 

*•  A. 

n 

Suppose  that  is  an  i.i.d.  sequence  with  marginal  d.f.  F. 

-1  ” 

Let  F^(x,o))  = n J]  denote  the  empirical  distribution  of 

the  sample  ...  . Under  the  additional  assumptions  that  F 

has  a bounded  second  derivative  F"  in  the  neighborhood  (x^-<5,  x^+6) 
and  that  the  central  rank  sequence  k^^  satisfies 

(4.1.1)  kj^  = nA  + o(n^  log  n)  as  n -»• 

Bahadur  (1966)  proved  the  following  representation  of  the  k^^-th  small- 
est order  statistic; 


ej"’  M - X,  • 


nF 


0(n  log  n) 


12() 


with  probability  one  (w.p.l),  'Ilien  defining  the  sample  X-quiintile  Y, 


of  ...  as  an  average  of  the  two  order  statistics  : 


md 


.(n) 


(2)  ’ the  centra]  rank  sequences  = [nX]  and 


kj^^^  = [nX]  + 1 each  obviously  satisfy  (4.1.]),  he  obtained 
(4.1.2) 


X-F  (X  ,a0 


where  R^(w)  = 0(n 


,V4 


log  n)  w.p.l.  From  the  representation  (4.1.2) 

it  follows  hianediately  by  the  ordinary  central  limit  theorem  for  sums 

of  i.i.d.  variables  having  a finite  second  moment  that  the  sjunple 

qu;intile  Y is  aswiptotically  normal  with  mean  x,  and  variance 
n ' A 


Moreover,  it  also  follows  that  the  law  of  the  iterated 


X(l-X) 
n[F'(x^)]“ 
logaritlvTi  holds  for  Y^  ; that  is, 


I n'^(Y  -X,  )1'' (x  ) 

m t ^ ^ ^ 


= 1 


= 1. 


n (2X(l-X)log  log  n]' 

Tlie  representation  (4.1.2)  has  been  extended  by  Sen  (1968) 
to  sample  quantiles  Y^  from  m-dependent  sequences  not  necessarily 
identically  distributed,  luider  certain  conditions,  ^md  to  those  from 
stationar)'  c{>-mixing  sec|uences  (see  Sen  (1972)  ).  From  these 
representations  Sen  also  gave  further  conditions  wiiich  are  sufficient 
for  obtaining  the  asymptotic  normality  of  Y^  as  well  as  the  corres- 
ponding iterated  logaritlim  result.  Additionally,  Gliosh  (1971)  has 
found  a representation  of  Y^  from  independent  or  m-dependent  sequences 
with  a weaker  convergence  rate  for  the  remainder  tern  , and  in  fact 
an  "in  probability"  rather  than  an  almost  sure  convergence.  ITiis  latter 
is  valid,  however,  under  fewer  assumptions,  including  requiring  the 
existence  of  only  the  first  derivative  F'  in  a neighborhood  of  x.  , 

A 
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and  no  longer  than  the  sample  quantile  be  defined  in  terms  of 

central  order  statistics  for  which  k satisfies  (4.1.1J. 

n ^ 

Moreover,  Ghosh's  procedure  is  substantially  simpler  than  that  of 
Bahadur  and  Sen  (1968),  and  the  representation  with  the  weaker  conver- 
gence rate  is  sufficient  for  many  purposes,  including  obtaining  the 
asymptotic  normality  of  Y^  . 

Using  tedmiques  similar  to  those  of  the  above  authors,  we  can 

obtain  analagous  representations  for  intermediate  order  statistics. 

For  convenient  comparisons  of  our  methods  and  results  with  those  for 

sample  X-quintiles,  we  deal  exclusively  with  smallest  terms 

, although  we  could  just  as  well  obtain  corresponding  results  for 
n 

largest  terms.  In  establishing  these  results  a crucial  assumption  we 
will  be  making  in  this  chapter  is  that  the  marginal  d.f.  F of 
(and  each  marginal  d.f.  of  a non -identically  distributed  sequence  ) 
has  a finite  left  endpoint  , with  additional  assumptions  to  be  made 
upon  the  behavior  of  F(x)  as  x approaches  Xq  , including  those 
given  in  the  hypothesis  of  Theorem  1.3.3.  These  of  course  will  corres- 
pond in  the  intermediate  case  to  the  fact  in  the  central  case  that 
X-quantiles  x^  are  necessarily  finite,  for  0 < X < 1,  and  to  condi- 
tions upon  the  behavior  of  the  d.f.  F in  a neighborhood  of  x^  . 

We  begin  with  the  development  of  a representation  for  intermediate 

order  statistics  from  independent  sequences  in  the  next  section, 

n 

and  in  Section  4.3  we  consider  a weaker  representation  under  fewer 
assumptions,  which  is  valid  also  for  the  case  of  m-dependent  and  not 
necessarily  identically  distributed  sequences.  Also  in  this  chapter  we 
provide,  as  corollaries  to  our  representation  theorems,  additional 
results  dealing  with  the  asymptotic  behavior  of  intermediate  order 


12« 


statistics;  specifically,  we  give  a law  of  the  iterated  logaritlvii  in 

the  i.i.d.  sequence  case,  ;md  for  in- dependent  sequences  we  indicate  the 

as>nnptotic  distribution  of  , which  is  already  establislied  for 

n 

i.i.d.  sequences  (Theorem  1.3.3). 

We  conjecture  that  our  results  can  be  e.xtended  to  intennediate 
order  statistics  from  <J)-mi.xing  sequences,  using  methods  similar  to 
those  of  Sen  (1972)  in  establishing  an  almost  sure  representation  for 
sample  A-quantiles  from  such  dependent  sequences.  However  we  will  not 
consider  this  problem  here. 

4.2^ I.i.d.  Sequences. 

bet  !•■  be  a d.f.  with  a finite  left  endpoint  such  tliat 

H(x^)  = 0,  and  suppose  that  inside  an  intcrv'al  (x^,  Xg+5) , f 

twice  dif ferentialile  with  T"  boiuuled  and  such  tliat  lim  F'(x)  exists 

xIXq 

and  is  positive.  Suppose  that  is  an  i.i.d.  sequence  of  r.v.'s  witli 

marginal  d.f.  F,  and  let  be  an  intermediate  rank  sequence  subject 

to  the  restriction 


(4.2.1) 


-y  CO  as  n 


log  n 

Define  a sequence  of  positive  mnnl^ers 

a^  = n'^  k^^  (1+c)  " log"''  n. 


where  c > 0,  and  a sequence  of  integers  b^^  satisfying 


k 

n 


log  n 

bet  X be  such  that  F(x 


as  n «>. 


= — . ( X exists  and  is  iniiciue  for 

n n ^ n ' 


A 


12‘) 


large  n,  by  the  assumed  differentiability  conditions  on  F.)  Let 

Fn(x,»)  . n'* 

be  the  empirical  d.f.  of  the  sample  ...  , and  write 


and 


Gj(x,o))  = F^(x,w)  F(x)  - + — 


H (w)  = -sup  |G  (x,w)|. 

X -a  < X < X +a 
n n n n 


Most  of  our  development  is  then  given  in  the  following  two  lemmas. 


Lemma  4.2.1.  With  probability  one, 


= O^n  ^ n)  as  n -*■ 


Proof:  Let  be  an  integer  such  that  x^  is  uniquely  dcl'ined  for 

n > . For  n > N'^  and  for  any  integer  r,  let 

By  the  monotonicity  of  F and  F^  we  have  for  x r [n^  i^]  . 


F„(n^  «.)  - S F„(x,o.)  - F(x)  X F„(n^„  „ 


, Oj)  ■ I'  i’  i i . 
' ^ r,n 


Thus 


K 

H^(o))  < nvix  (|F^(n^^^,  0,)  - F(n^^J  - F^(x^.  o))  + 


. max  {F(n^,i  ) - F(n^ 

-b  <r<b  -1 
n n 


(4.2.2)  = , 


say.  Since  . a^  - x^  , and  by  tlie 

assumed  conditions  upon  F in  the  lixed  interval  (x^,  Xq+(S),  we  liavc 


that 


.2.3] 


IVc  will  use  the  followinij  ineqiuiJity  of  Bemstein  {see  li;ih;iclur 
(l‘Jb6)  ):  Let  B{n,p)  be  a binomial  r.v.  with  par;uneters  n ;ind  p 

for  some  integer  nil  and  for  0 < p < 1.  llien  for  every  t > 0, 

14.2.41  P(|B(n,pl  - np|  > t)  < 2 exp{-h). 


where 


li  = h|n,p,t)  = 


2jnp(]-p)  +^ax(p,l-pl 


l.et  C,  1 im  I 'fx)  > 0.  Ke  mav  choose  .X,  > N,  such  that 

XI  x„ 


" ^‘n>  ■ ‘''^"n*  " S"n  ' ''^^i  ' '"n’  " 4^n  ’ 


n > N,  . Now  for  any  n • .N'j  :ind  any  integer  r. 


(i  In  ) = i 

n r , n ' 


^ ^[x  <f]-5'n  ] ^r, 

1=1  n M r,ir'  ’ 


n 


if  r > () 


-1  ^ 

-n  * I 1 


‘[n  <r.fOc  ] ^ I’r 
1 = 1 r,n  in' 


,n 


if  r s - 1 , 


vhere 


P = 'L'{n  ) - — I 

*r,n  • r,n  n ' 


_ I i 4 

Letti.  t’  t = C,  n log' n for  some  C,  > 0,  we  therefore  have 

•’  n _ n ^ 2 

bv  (4.2.41 . 


I’dc;  {n  1 I > t^]  < 2 exp(-h  ), 
^ ' n r,n  ' n'  ‘ r ,n  ’ 
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nt 


+ t ■ 

* r ,n  n 

Since  n > N_  and  |r|  s b imply  p < C,  a , we  have 
^ n X*  1 n 

P(lG^(n^^^)l  ^ t J < 2 exp(-6^) 


for  n > N-,  and  |r|  < b , where 
2 ' ' n 


nt 


^n  2C  a +t  ’ 
Inn 


which  does  not  depend  on  r.  Therefore 


P(K  > t ) < y P(|G  (n  )|  2 tj 
n n ' n r .n'^ ' n-* 

r=-b 

n 


< 4 b exp(-(S  ) 
n * n 


< 4 n exp (-6^) , 


An  easy  calculation  shows  that  cS  > 


2C^(l+e) 


T — log  n for  n > N-  , 
""+1 


say,  so  that  for  given  C,  and  c,  choosing  C,  sufficiently  large 

2 ^ ^ 

C 

^2 

such  that 1 — > 2,  we  obtain 

2Cj(l+f)  •'+1 

y p(K  ^ t ) < 

-M  n n 
n>Nj^ 

Thus  by  the  Borel-Gantelli  lemma, 


P(K^  tj^  infinitely  often)  = 0, 

and  since  t = Ct  n ^ k"  log^"^^  n,  the  statement  of  the  Icinma  follows 
n 2 n ’ 

from  (4.2.2)  and  (4.2.3). 


Lemma  4.2.2.  With  probability  one. 
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X - a < (w)  < X + a 

n n k ^ n n 

n 

for  all  laryo  n (that  is,  for  all  n some  N(u))  ).  Note  tliat 
X,,  < X - a for  all  larec  n,  bv  the  clioicc  of  a , the  assumed 

0 n n h > , j,  > 

conditions  on  1',  ;uid  (4.2.1). 


Proof:  first  we  liave 


P(f„^  ’ < X - a ) < P(  y If,  1 ’ ) 

'■ 'k  n IV  ' L ■■"X  -a  j IV 

n j=l  J n ir 


= Pf  y r,  T - nn  > k - np  1 

L‘)--x  -a  J 'n  n *n^ 
1=1  I n n 

n 

^ I’f  y I 1 ■ i>n  > C._  na  1 

'■•'i  LS-^x  -a  1 -n  .‘)  n-" 

1 = 1 1 n it' 


where  p = idx  - a ),  for  some  > 0,  and  for  all  larec  n,  since 
‘n  n n .•)  ^ 

k 

a = of-— 1 by  (4.2.1),  ;uid  since  1-'  exists  and  is  hounded  awav  from 
zero  in  some  fixed  interval.  Hien  by  (4.2.4), 

r r2  2 2 ^ 

f-7n  a_ 


P[f,f'^^  < X - a ) < 2 e.xp  - ^ ■ 
Ukn  n n^  ^nii^^f^na  i 


r 2 2^1 
C.n  a 

T 4 n 

..  2 exp  - 

n 


for  some  C,j  > 0 (not  dependini’  on  c ) and  for  large  n,  since 
k k 19*^ 

p : — and  a = of-^l.  Hut  k '^n^a'"  = fl+e)log  n,  so  that  if  ».  0 

‘ n n n *^0  n n t-  » 

is  chosen  sufficiently  large,  we  obtain 


(4.2.5) 


L ^ M 


n>Nj  n 


In  a similar  way  we  have 


Pfi-.f"*  > x + a ] < pf  I Ir.  ^ , 1 < k ) 


i 


<-Hl  I 


i^l  ‘[q>x,%]  "‘n  ^3 


- np  > C,  na  ) 

* n s n' 


for  large  n,  where  now  p =1-F(x  +a).  Then  the  relations 

* ' n n n 

k k 

F(x  + a ) < — + C,  a ;md  a = of~]  along  with  (4.2.4)  lead  to 
n n n In  n ''n  •'  ^ 

,,2  2 

f \ a 

r,  r^(nj  . ..  •\  _ T f 5 n-\ 


^ 2 -p(- 


for  some  > 0 :md  for  large  n,  so  if  e > 0 is  sufficiently 


large, 


(4.2.6) 


J ’’<4"^  " '^n  * “n)  ' “■ 

ns;Nj  n 


Combining  (4.2..S)  and  (4.2.6)  and  applying  the  Borel -Cantel  1 i lemma 
completes  the  proof. 


Our  main  result  is  now  easily  obtained. 


Tlieorem  4.2.3.  Let  be  Jin  i.i.d.  sequence  of  r.v.'s  with  marginal 
d.f.  F having  a finite  left  endpoint  x^  such  that 
such  that  in  an  interval  (Xg,  Xg+6) , F has  a bounded  second  deriva- 
tive, and  lim  F'(x)  > 0.  Let  k be  an  intermediate  rank  sequence 
=^+^0  k 


such  that 


«>,  and  for  sufficiently  large  n define  x„ 
log  n ’ / n 


by  F(x^)  = — . Then 


k -nF  (x  ,0)) 


(4.2.7,  V“). 

n n 


wlicre 


(4.2.8)  " 0(n’*  n)  with  proliability  0!U'. 
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Proof : l-'rom  Lcnmuis  4.2.1  and  4.2.2  it  follows  that  w.p.l, 

k 


n 


-(n), 

. 

'"n 


Since  f has  a bounded  second  derivative  in  (xq,  and  since 

a^^  = o(l).  Lemma  4.2.2  gives 


n n 


f ")  ^ n 

w.p.l.  'Ihen  since  we  may  assume  (w.p.l)  tliat  F (cj) , w)  = ’ 

n K ii 

n 

noting  tkit  I'(Xq)  = d,  and  from  the  assumption  that  boundeil 

away  from  zero  for  large  n,  the  theorem  follows. 

k 


k satisfies 

71 


log^  n 


which  is  slightly  more  I'estrictive 


than  (4.2.1),  then  as  is  evident  the  representation  (4 . 2. 7J - ( 4 . 2. 8 ) 

verifies  the  as>miptotic  normality  of  stated  in  Tlieorem  1.3.3, 

n 

under  stronger  conditions  upon  the  marginal  d.f.  F.  However  we  m.ay 

use  our  representation  to  estalilish  as  a 7ieiv  I'csult  a law  of  tlie  iler 

ated  logaritlmi  for  . iliis  lias  been  obtained  e.xplicitly  for 

n 

inteniiediate  order  statistics  from  i.i.d.  sequences  of  r.v. 's  unifoniily 

distributed  on  the  imit  interval  bv  Kiefer  (1972,  Theorem  5),  under  tiie 

k_. 

restriction  th.it 


log  log  n 
the  f;unirKir  relation 


Tr;inslating  liis  result  accoi'ding  to 


1-  (X  ,(jij  = n 
n n’ 


k 


-1 


I 1 


(w)  , 


i=l 


noting  that  I’fiq;.)  ^^'-'1  - lor'  all  suf ficient  1\'  Uirge  n,  and 
using  the  rejiresent.'it  ion  ( 1 . 2 . 7 ) - ( 4 . 2 . H ) , v^ilitl  under  our  assinnjit  ions 
upon  the  m;irgin;il  d.f.  F,  wc‘  easily  obtain  tlie  following  theoiem. 


Theorem  4.2.4.  Let  ^ be  an  i.i.d.  sequence  with  marginal  d.f.  F 
satisfying  the  conditions  of  Theorem  4.2.3.  If  satisfies  the 
restriction 

k^(log  log  n]^ 

= oo  as  n 

log'  n 


then 


P 


lim  + 
n 


nl-'(x  ) 

^ n-^  n-" 

(2kj^  log  log  n)'^ 


1 


1. 


4.3.  Independent  or  m-dependent  Sequences  Under  Weaker  Conditions. 

Following  a procedure  used  by  Ghosh  (1971)  to  extend  tlic  Bahadur 
representation  of  sample  A-quantiles  from  independent  sequences  under 
weaker  conditions,  we  will  derive  in  this  section  a similar  result  for 
intermediate  order  statistics , which  will  be  valid  also  in  the  case 
of  m-dependent  sequences.  Specifica] ’y,  the  assumptions  which  will  no 
longer  be  required  include  the  existence  and  boundedness  of  the  second 
derivative  of  the  marginal  d.f.  of  in  the  neighborhood  (x^, 
adjacent  to  its  left  endpoint,  as  well  as  the  restriction  (4.2.1j  upon 
how  slowly  the  intermediate  rank  sequence  k^  tends  to  infinity.  By 
removing  these  conditions  we  will  be  left  with  only  those  actually 
given  in  the  hypothesis  of  'ITieorem  1.3.3,  which  established  the  asymp- 
totic normality  of  when  the  are  independent.  'Die  resulting 

n 

representation  however  will  correspondingly  be  for  the  most  part  weaker, 
in  that  a slower  convergence  rate  for  the  remainder  term  , and 
moreover,  an  "in  probability"  rather  than  an  almost  sure  convergence 
statement,  will  be  obtained.  But  the  rate  will  still  be  sufficiently 


r 
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fast  to  insure  the  asymptotic  normality  of  in  the  i.i.d.  case  as 

^in  immediate  corollan'. 


'Hie  method  we  use  is  somewhat  simpler  than  tliat  followed  in  Sec- 
tion 4.2,  and  in  the  present  section  it  is  of  only  slight  inconvenience 
to  in  fact  consider  a more  general  setting  in  which  the  identically 
distributed  assumption  is  relaxed  to  some  extent.  We  therefore  do 
this,  and  follow'ing  our  development  we  indicate  the  specialization  to 
i.i.d.  as  well  as  to  m-dependent  stationary  sequences. 

Thus  let  be  an  m-dependent  secjuence  (m  > 0)  with  marginal 

d.f.'s  each  n > 1,  x^^  is  the  finite 

left  endpoint  of  such  that  F^(xgi  = 0,  iuid  in  an  interval 

fXr,,  x„+6),  F has  a continuous  derivative  F'  such  that  1 im  F'(x) 

xF.Xq 

exists  and  is  positive.  .Now  define 

Given  aji  intennediate  rank  sequence  , for  each  i = 1,  ...  ,n  let 

X be  such  that 
n,i 

k 

!■■.  (X  -■)  = — , 

j n,  j n 


and  let  x^^  be  such  that 


F,  (x  ) = — . 

(n)  n'^  n 

(llicse  exist  uniquely  for  all  sufficiently  large  n .)  Further  assume 
that 


(4.. 3.1)  X . - X = o 
^ n,  1 n 


U 

rk " 
n 

n 


, unifoniily  in  i = 1 , . . . 
as  n -»■  ® (which  implies  that  .x^  ->  Xg  ) , and  that 


,n, 


J 
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(4.3.2)  lim  n ^ I F-' (x  ) = lim  F'  . (x^)  > 0. 
n i=l  ^ " n " 

(The  limit  is  assumed  to  exist.)  Finally,  assume  that 


(4.3.3) 


lim 


where 


Theorem  4.3.1.  Under  the  above  conditions, 

n 

Cn-v  .^,^[5-<x  .] 

(4,3.4)  {M  . ; * "■*  . R 

Si  " nF;  , (S  ) " 

(n)  '■  n-^ 


where  ^ R ^0. 

i.'i  n 


Proof : We  first  assume  that  the  ^ are  independent  and  later  indi- 

cate the  modifications  to  be  made  for  the  more  general  m-dependent 


For  any  real  t we  have  for  sufficiently  large  n. 


-1  - j,  ■ 


[5.  <x  +— H] 
n n 


1 II  r Lk  h 
= P -T ^ I ]f.  X +—  - I 


1 ^ ^ 1 
1 I F.  ; . ^ - Jl. 


say.  Since  F,  x + = — + -.(x  J + o — , we  have  that 

^ (n)  [ n n j n n (n)  ^ 1”  J 


t = -r 
»■»  • . 


ftk' 

n J n tT' 


i/^TT.  rv  \ 1 ri  (n)'  n'' 


k^p;  ,(x  ) 

n (n)  ^ n 


n 


(4.3.6) 


>■  t , as  n 


Suppose  t ''  0.  I.et 


W = 
n 


i ^ i n 


k'F)  ,(x  ) 
n (nj  ^ n 


.Ufr-'[c..x  .] 

1=1  1 1 n,i 


By  (4.3.1)  we  luive  for  large  n that  x ■ < 

n , J 


X + — , so  tliat 


n n 


(4.3.7)  W„  - Z 


1 


t>  k^'  fx  ) i=l 

V(n)^-\^  ^ '■ 


I I 


[x  . < 5 ■ X + — 
n,  1 1 n n 


tk2 


where 


p - = F; 
' n , 1 I 


tk‘ 


X + — t 

n n 


Since 


K(W  - „ 

'■  n t , n 


)-  = 


f;-  !(fri^  Ji 


1 r 

T L P,-|  i ’ 

F:  .(xir  i>i 


y p . = n F,  . 
‘ n,i  (n) 


I ^ r 


X + 

n n 


- k 


= k - tk^^F'  x(x J . o(k-)  - k„  , 


;md  since 
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it  follows  that  ' ^t  ^ n -*■  «>,  so  that 


(4.3.8) 


W 


n 


0. 


Similarly,  (4.3.8)  holds  for  t < 0.  Also,  by  the  usual  central  limit 
theorem  for  row  sums  fr«n  triangular  arrays,  it  is  easily  seen  that 


(4.3.9)  =>  n[o,  [lim  (Xj^)]'2j  , 

so  that  in  particular  the  sequence  of  distributions  (i^(W^) , n>l}  is 
tight. 

Let 


V = 
n 


'4"’ 

n 


Then  by  (4.3. 5) - (4. 3. 9)  we  liave  that  V and  IV  satisfy  the  condi- 

n n ^ 


n 


tions  of  Lemma  I of  Ghosh  (1971),  tlmt  is,  the  collection  SC(W^)}  is 
tight,  and  for  all  real  t and  all  e > 0, 


lim  P(V  <t,  IV  > t+e)  = 0 
n ' n • n 

iind 


lim  P(V  >t+c,  W <t)  = 0 
n " " 

P 


Therefore,  - VV^  ().  Hence  for  defined  by  (4.3.4), 

n 

f*^n  .]) 

1=1  ‘■^1  n,!-* 


k4  " k ^ 


- X 

, ’k  ^n 
I n 


nF)  . (x  ) 
(n)'^  n" 


_ n ~ -1  1 


,,  (4"'  ■ s)  - - 


n 

I 


fk_ 


kT|  ,(x  ) i = l 
n ( n ) n 


_n  . , 1 

n ]| 

‘•1  n,!-*) 


= V - w 
n n 


r 
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We  now  indicate  the  modifications  to  be  made  in  order  to  establish 
the  theorem  for  m-dopendent  sequences.  We  need  to  show 

W^^  satisfies  the  first  condition  of  Lemma  1 
(4.5.10)  of  Ghosh  (1971);  that  is,  the  sequence  {^(W^)} 
is  tight, 

and 


(4.5.11) 


H(W^^  - > 0 as  n > «>. 


To  show  (4.5.11)  we  use  the  following  result  of  Rosen  (1967):  If 

Yj,  ...  are  m-dependent  (n  m)  and  have  finite  variances,  then 

n n 

(4.5.12)  Var(  I Y.)  •'  (2m+l)  I Var  Y.  . 

i=l  ‘ i=l  ' 

Applying  this  to  (4.5.7)  yields 

n 

1 


I'TW  - )■ 

^ n t,n 


k {t;  ,(x  )}• 

n (n) ^ n 


i = l 


n,  1 


which  tends  to  zero  as  in  the  independent  case. 

In  order  to  show  (4.5.10)  we  employ  the  following  central  limit 

theorem  for  row  stuns  from  triangular  arrays  of  r.v.'s  with  m-dependent 

rows  ( m ^ 0 fixed),  due  to  Rosen  (19(i7):  Let  (X  •}  i , , with 

^ ^ n,i  n.:l  ,lsi<n  ’ 

d.f.'s  T -(x)  = l’(X  . ; x)  be  an  array  of  r.v.'s  with 

X ,,  ...  ,X  m-dependent  for  each  n r m + 1,  tmd  let  S = 7 X 

n,l  ’ n,n  ‘ ’ n n,  i 


r ^ 
Urn  I 

n i=l 


li  X . 

= 0 

for  all 

n,  i , 

n,i 

Var  S 

n 

= 0 

for  all 

n , 

2 

X 

dF 

.(X)  = 0 

for  al  1 

1 X I >c. 


n,  1 


c > 0, 


L 
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j 1 

lim  y Var  X • < » , 
n i=l 


->  N(0,1) 


Now,  wc  first  note  that 


- -I 

, n [C-^x  .]  n 

(4.3.13)  W = - ^ o I 


If  (4.3.2)  holds,  then  it  is  easily  shown  that  the  array  {X  ,},  for 

n > 1 

n large  and  1 < i < n,  given  by 


satisfies  the  assumptions  of  the  above  central  limit  theorem,  so  that 


ii 

S = y X . ->  N(0,1) 
n n,i  V . ^ 


■flien  using  (4.3.12)  again  we  have 


u 1 uiv.  ^ 

^ ^ (2mM)  -^(1  - J^)  = (2m^)(l  + o(l))  , 
n n 


n '■  n 


;ind  it  is  clear  from  (4.3.13)  tlwt  (4.3.10)  holds;  that  is,  the  collec- 
tion fiC(w^)}  is  tight  (but  not  neces.sarily  weakly  convergent).  Hie 
proof  of  the  theorem  is  now  complete. 


For  identically  distributed  scciuenccs  wc  may  replace  the 
x^  ^ , i = I,  ...  ,n,  by  ~ disregard  (4.3.1); 

additioniil  ly  in  this  instance  the  assumption  (4.3.2)  is  redundant.  I'or 


r 
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i.L.d.  sequences  (4.3.3)  is  trivially  satisfied  ;ind  hence  we  liave  a 
representation  generally  weaker  than  that  in  ITieorein  4.2.3,  hut  using 
fewer  assuinjitions  on  the  marginal  d.f.  and  having  no  restriction  upon 
the  intermediate  rank  sequence  k^^  . Also,  for  stationary'  m-dependent 
sequences  (m  > 1)  (4.3.3)  becomes 


lim 

n 


k -{k  +2  y (n-i) [P(f,  <x  , (ii.-ix  ) 

iH  n i=i  ^ L V n ^l  + i n 


-1 


< CO 


vdiich  holds  if 


111 


, — y (n-i)[P(^.<x  , ^,,.<x  ) - 
k 1 n’  1+1  n 

n 1=1 

is  bounded  away  from  -1  for  all  large  n. 


(n) 


finally  we  note  that  the  asymiptotic  normality  of  ^ easily 

n 

follows  as  a corollary  to  the  representation  (4.3.4),  by  (4.3.3)  and 
again  upon  using  the  central  limit  theorem  of  Rosen  (1967).  We  state 
this  fonnally  as  a theorem. 


llieorem  4.3.2.  Under  the  same  conditions  as  Theorem  4.3.1,  and  with 
the  previous  notation. 


nf I ^ (x  ) , , , 
^i)_  n L(n) 

■k 


->  N(0,1)  . 


CHAPTER  V 


FURTHER  RESULTS 

IV/o  miscellaneous  results  relevant  to  our  study  of  intennediate 
order  statistics  will  be  obtained  in  this  chapter.  These  results  may 
be  regarded  as  supplementary  to  our  previous  work,  in  that  we  will  not 
attempt  to  develop  them  to  the  fullest  potential  generality  and  useful- 
ness. Instead,  we  let  them  serve  to  indicate  directions  for  further 
theoretical  investigations. 

5.1.  The  Second  Moment  of  the  Remainder  Term  In  the  Intermediate  Order 
Statistic  Representation . 

In  this  section  we  derive  an  asymi)totic  approximation  to  the 
second  moment  of  the  remainder  term  appearing  in  the  representa- 
tion of  the  intermediate  order  statistic  given  in  Tlieorem  4.2.3. 

n 

Such  iin  asymptotic  expression  has  been  obtained  for  the  second  moment 
of  the  reniiiinder  term  appearing  in  the  Bahadur  representation  (4.1.2) 
of  sainple  X-quantiles  by  IXittweiler  (1973),  who  has  discussed  the  par- 
ticular application  to  a problem  involving  stocliastic  processes  of 
interest  in  engineering,  which  motivated  the  consideration  of  the 
approx imat ion. 

In  our  situation  we  retain  all  of  the  assumptions  upon  the  mar- 
ginal d.f.  I-  of  made  for  the  result  (4 . 2 . 7)  - (4 . 2 . 8) , and 
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additionally,  as  did  Duttweiler,  we  impose  tl\e  requirement  that 


K = j dF(x)  < We  also  make  an  assumption  slightly  stronger 
tluin  (4.2.1)  as  to  liow  rapidly  the  interned  late  rank  sequence  k 


tends  to  infinity;  here  we  suppose  that 


for  some  0 > 0.  Under  these  conditions  we  have  found  tlvit  Duttweiler's 


procedure  can  essentially  be  carried  through  for  the  intermediate  ranks 


case,  leading  to  an  estimate  of  the  quint ity  F , which  is  nearly  as 


precise  as  the  corresponding  estimate  in  the  central  r;mks  case.  Whether 


our  approximation  has  a similar  useful  application  remains  to  be  seen. 


(>wing  to  tlie  basic  fact  that  the  expected  value  of  the  k-th  small- 


est order  statistic  of  a sample  of  n variables  distributed  unifoniily 


k k 

on  the  unit  interval  (0,1)  is  rather  than  — , it  turns  out 


that  a substantial  simplification  in  the  procedure  is  effected  by 


dealing  witii  a representation  for  slightly  different  from  that 


given  in  Tlieorem  1.2.3.  In  fact,  let  us  consider,  in  place  of  (4.2.7), 


the  representation 


nk  n 

iT+T  ■ -I  '[> 

(5.1. n ■ .X,;  * 

n n 


where  x^  is  defined  by  large  n,  f being 


marginal  d.f.  of  the  i.i.d.  sequence  . (\n  inspection  of  the  proofs 


in  Section  4.2  reveals  tliat,  as  should  be  intuitively  obvious,  x^  can 


be  replaced  by  .x^  throughout,  leading  to  the  conclusion  that  for  ir 


defined  liy  (.S.1.1),  we  have 


R^(m)  = 0(n  ^ ^ '■>)  with  probability  one. 


I 

J 
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llie  following  preliminary  result,  which  we  state  as  a lemma,  gives 
an  exact  expression  for  the  second  moment  of  IV  when  F is  the 
uniform  (0,1)  distribution.  Hie  details  of  its  proof  may  be  found 
in  Duttiveiler  (1973). 


Lemma  5.1.1.  Let  be  tlie  k-tli  smallest  order  statistic  for  the 

set  U^,...,U^  of  n independent  r.v.'s  eacli  distributed  uniformly  on 
(0,1).  Define 


(5.1.2) 


i(ii)  - 


n+1 


n 

iL 

^ 1 n+l-‘ 


-"(i-sn) 


iind  let 


llien 


LR^  = 


2k 


n(n+l) 


<2 


(n+lUn+2) 


I j,  (k,  n+l-k) 
n+1 
k 


I ^ (k+1,  n+l-k) 

iviT 


n(n+l)  (n+2 ) 


where  I^(a,li)  is  the  incomplete  Beta  function,  defined  by 


i,,  _ (a+b-1)! 

~ ‘(TTTTITH^ 


a-1,,  , ..b-l , 
y (1-y)  dy. 


Using  this  result  we  may  now  derive  an  approximation  to  the  second 
moment  of  R^'^  under  the  assunptions  of  Section  4.2.  As  noted  earlier 
we  will  be  closely  following  Duttweiler's  proof  for  the  sample  X-quan- 
tilc  case;  liowever  for  clarity  we  will  here  present  most  of  tlie  details 


Hicorem  5.2.2.  Let  F he  a d.f.  with  finite  left  endpoint  x^j  such 
that  I (^q)  " suppose  that  inside  an  inteival  (.Xj^,  Xj^+6),  F 
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is  twice  di  rfercnt  iiiblc  with  I'”  boinided  and  such  that  1 ini  I- '(,■<) 

xlx^ 

exists  (finite)  and  is  positive.  Suppose  is  an  i.i.d.  secpience 


witli  inarjiinal  d.f.  1',  and  assimie  tliat  lif, 


x-dJ-'i-x)  < bet  k 


be  an  inteniied iate  r;uik  miuence  satisfying  - «>  for  some  0 > 0, 

k " 

ajid  let  lie  sucli  that  (lor  large  n ).  Ihen  for  ir 


defined  by  (5.1.1),  we  have 


I ^ 

1 ->  I 

i(R’)“  ~ --r 

” " (nl'(x;)]- 


as  n 


I’roof:  Let  11^,11^,...  be  independent  r.v.'s  luiifoniily  distributed  on 


,(n) 


(0,1)  anil  let  Ik  be  the  k -th  smallest  o . Ik'line  the 

k n 1 ’ n 

n 

qiKuitile  funct  ion  Q(*)  by 


()(u)  = siip{x:  f(x)  • u). 

I'hen  for  each  i 1 , Q(lb)  Iras  d.f.  L,  and  moreover,  as  in  Ikitt- 
weiler  ( 1(17.5)  we  liav'e  tliat 

nk|^  n 

(Ml 

S,  ~ J \ nf'lx’) 

n n 


where  ~ imlicates  having  idiaitical  distributions. 

from  the  assumptions  on  tlie  d.f.  f we  may  as  well  suppose  tliat 

l '(x)  is  iKisitive  in  the  intenal  A = (.x^^,  Xjj+6) . Let 

K = (u:  ii=f(x),  XiA).  'Ihen  Q restricted  to  B is  the  inverse  of  f 

restricted  to  A.  Since  x^'^  x^^  , there  is  an  integer  .Mj  such  that 

k 

V ■ B if  n N,  . Ihiis  for  n • , 

nt-l  1 1 


(5.1.5) 


n 

n+ 1 


1 
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(5.1.4) 

I'Ulti 

(5.1.5) 


Q' 


n+1 


exists  and  equals  (p'(Xj'p) 


-1 


Q(ii)  < x'  if  and  only  if  u < — ^ 
n •'  n+1 


Also,  it  is  clear  that  Q”  exists  ;md  is  bounded  in  B (see  Van  Zwet 
(1904,  p.  24)  ).  Moreover,  we  have  the  relation 

a 


Q^(u)du  = Kf.J  < 


(lo  sec  this,  lirst  regard  Q as  a (Borel-)  measurable  transformation 
from  the  luiit  interval  into  the  real  line,  and  let  \i  be  Lebesgue 
measure.  Hicn 

^ r 2 -1 

Q (u)du  = X d(uQ  ■^)(x), 

0 J-oo 

where  the  measure  is  defined  by  pQ’^(h)  = m(q'^(E))  for  Borel 

sets  fi.  By  merely  considering  bounded  semiclosed  intervals  we  nuiy 
verify  that  pQ  ^ is  in  fact  the  Lebesgue-Stieltjes  measure  corres- 
ponding to  r .) 

Now,  for  n > 1 ;ind  u c [0,l],  define 


llj^(u)  = Q(u)  - Q 


h+T 


r k 


- Q' 


n+1 


k 

h^Tl- 


llien  by  (5. 1.3) -(5.1. 5) , for  n > we  have  that 


r k. 


R’  ~ Q 
n ^ 


n+1 


+ g- 

k 

n 

h+1 


k 

n 


n+1 
n 


,(n) 


n+1 


+ II 


.0^)1 


I i 


i = l 


['V.41 


ni-'IXj^') 


L 


r 
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Ilk  n 

T-  I ^ 


n+1 


11+ 1 


[U.'-y]] 
'■  1 ii+H 


n 


II 

-1J„(I1,  _Si 

11+ 1 
n 


- II 


1 - 


n+1 , 


n 


(S.1.0)  = 


1 LJ) 

ir  k 


k "k 

n II 


/\  r \ 

wlierc  u!”  is  uivon  by  (S.1.2).  Now  by  I.eiiiiiui  5.1.1, 


- u["V  = 

n n 


2k 


k_.  ^'k.  > ~ nTTiMTi*  k_'‘'ii’  ■'ll'  ' k_/‘'ii  II 


(k  , Ii+l-k  ) - I , (k  +1,  n+l-k  1+0 
II  ’ ir  k ” " ‘ 

_n 

n+1  n+r 

l-roin  Abnuiiow  it  z ;iiid  Stev’un  (l‘->bl,  bquatioiis  2b.  5.  lb  and  6.1.57)  and 
IVilks  (19t)2,  p.  177)  we  liav'e  tbo  relation 


_n 

3 


1 , 1 . 1,^1  1 , (a+b-1) ! a, , ,b 

l^(a,b)  - l,,(a  + l.  b)  = X (1-x) 


for  positive  intei;ers  a aiul  b,  and  Stirling's  I'onnula 
n!  = e '*  n’’^  (27t)  ‘ [l  + 0(n  ^)]. 


I'herc  fore 
^n  ^n 


2k  , 

n n! 

iTTn^D-  * k;T(iTTT!- 


k 

II 

n+1 


fn+l-k; 
'n+T- 


n+1  -k 


(7)^ 


k" 

ii_ 

iiTiV+lT 


(1  + o(lj]  + 0 


n-k 

2 

n 

-V 

T 

II 


1, 

2 , 

n+1  -k 

f n 1II+I 

n 

^ii+P 

n 

n 


ii+l-k 


n 


1 I ^ 

r 

5.  1 

i.7) 

= (: 

2-|b  11 
iT^  T 

1+0 

! 

n 

n 

n 

(|)'M  (1  ^ 0(11). 
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To  complete  the  proof  of  the  theorem  it  is  clearly  sufficient  from 
(5.1.6)  and  (5.1.7)  and  by  the  Schwarz  inequality  to  show  that 


En2(uf"^]=o 


n 


n 

n 


Choose  (S,  0 < 6 < i . Let 


;md  I = 
n 


kn 

max(xp,  - c^},  . Denoting  the  probability 

,(n) 


density  of  by  g , we  have 

n 


E = 

n 


fr(u)gn(u)du 


= ( 


uc  I 


u41 


) H^(u)gj^(u)du. 


Let 


and 


H 


n,max 


= sup  |ll(u)| 


Uel 


sup  g„(u). 


Then 


^n,max  ”n' 


E ::  11^ 

n*^  k n 


n,max  J 

9 


ue  I 


g (u)du  + g_ 

^n  ^,max  | ,^  n 


n 


1 


u41 


H„(u)du 


n 


Jr(u)du. 


= + g„ 

n,max  ^,max 

V.; 

19  2 2 2 

Also,  by  the  inequality  j(a+b+c)“  < a + b + c for  real  a,  b,  and 


c, 

3 


1 


lr(u)du  < 


1 


0 


Q (u)du  + 


1 


( k 


n 


n+1 


2 2 

< VI,l  + 


n+1 


f ( '<„'i  1 

Q.  ( n 


du  + 
2 


rl 

0 


Q’ 


n+1 


n+1 


du 


n+1 


Since  E^j  < «>,  by  (5.1.3)  and  (5.1.4),  and  since  P'(Xj^)  tends  to  a 
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non-zero  limit,  tlierc  exists  a finite  constant  Cj  such  that  for 


n > , 


ircujdu  < Cj  . 


Hence  for  n > , 


(5.1.8)  V.  11‘^fuf"^)  r;  11"  + C\  g 

n*-  k ^ n,max  1 ^n,mt 


max 


Since  e ->  0 we  may  choose  > .M,  such  that  I e B for  n > Nt 
n ^ 2 1 n 2 

Then  letting  = max  |Q''(u)  | < we  have  by  Taylor's  exp;msion, 
ut  B 


QUO  - Q 


n+1 


u - 


n+1 


O' 


k 


n+1 


C. 


u - 


k -,2 
nl 

n+1 


for  u c 1 , and  therefore 

n 


(5.1.9) 


f 

7 

11  ^ 
n ,max  2 n 


if  n ^ N , . 

Now,  we  observe  that  the  density 


, k -1  n-k 

" Tk  '-n?(n-k  )r  " ” 

n n 

k -1 
n 

II  -*  V-  tl. 

n n- 1 


has  mode  m„  = v ajid  decreases  monotonical ly  on  both  sides.  Since 


(5.1.10) 


2k 

k k -1  I 1 0- 

__ri  . ,Ji = n+1 

n+1  n-1  I n-r 


it  is  clear  that  m^  e for  all  sufficiently  large  n.  Let  k '■  1 
We  have 


i:  II 


k n+1 
n 


zk 


u - 


n+1 


ZK 


g,^(u)du 


i^+  1 

rn+1  n 


/•n+1  n c k 'I  2k 
> u - g^  (u)du 

> m ' ’ 
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- Sn 


Sn 


r k rl 

U * 'n)  1, 


k 

n+1  n 


u - 


k ')  2k 
n| 

n+1 


du 


(2<  + 1) 
k 


2k+1 

f "nl 

2k+1' 

e 

n 

K ■ n+lj 

Since  ne^  -*■  «>  whereas  = 0(n  ^),  by  the  first  equality  in 

(5.1.10),  there  exists  > 0,  depending  on  k,  such  that 

k 


(n) 

k n+1 
n 


k -v  2k 
n 


> C,  g 
5 


or 


«n 


n+1  n 


+ e 
n+1  n 


k -1  2k 


2k+1 


? -.N  e(u,M  - c;'  , 


^k  n+1 
n 


for  sufficiently  large  n.  In  a similar  manner  there  exists  > 0 
such  that 


n+1  n 


< E U. 


,(n) 


k 1 2k 
n 

n+lj 


C-1  ^-(2k+1) 
4 n 


if  > 0 infinitely  often,  and  g^^ 


n+1  ■ ^n 


= 0 if 


< 0 for  all  large  n.  Thus  letting  = min{C^,C^}  in  the 
former  case  and  = C,  in  the  latter,  we  have  for  n > > N2  , 

k -V  2k 


n,max 


, du/">  - c;'  . 


kn  n.lj 


SW 

n 


Since  (see  Blom  (1958,  p.  42))  there  is  a constant  C,  < “>  indepen- 


dent of  n,  k , and  k such  that 
’ n 


E 


f /■  \ k ■>  2 
n 


it  follows  that 
(5.1.11)  g^ 

for  n > Nj  . Combining  (5.1.8),  (5.1.9),  and  (5.1.11)  then  leads  to 


^ s C,  C'^  n'*^ 
^n,max  65  n 


IS2 


n 


I-  ir  (j, 
u k 


, , ^2  4 ^ „ ^-1  -K  -fZK+l) 

s C,t^  ♦ CjC^Cj  n 


Cor  n ^ Nj  . Finally,  we  may  suppose  that  > n for  some  0 > 0 
and  for  all  large  n,  so  that 

^ ^j^>5-06^2k+1  ^ ^V66(2k+1) 

and  since  k is  arbitrary,  we  may  choose  it  sufficiently  large  to  obtain 

= 0 , which  completes  the  proof. 


E ir  U, 
n k 


(n) 

ii 


5.2.  Weak  Convergence  of  Stochastic  Processes . 

In  this  section  we  introduce  a stochastic  process  having  a rela- 
tionship to  intennediate  order  statistics,  ;inalagous  to  that  which  the 
well-known  ''empirical  process"  has  to  sample  A-quantiles.  There  being 
substantial  studies  of  the  empirical  process  having  been  made  ;ind 
presented  in  the  literature,  with  a large  number  of  theoretical  :md 
applied  results  obtained,  we  conjecture  that  a corresponding  extensive 
theory  could  be  developed  for  the  process  we  define.  However,  since 
the  asymptotic  distribution  theory  of  intennediate  order  statistics  has 
been  our  primary  interest  in  this  investigation,  we  study  only  the 
corresponding  basic  concept  for  stochastic  processes,  that  of  weak 
convergence,  leaving  open  other  potentially  useful  considerations. 

We  begin  with  a brief  sketch  of  the  background  tools  and  teirnii- 
nology  pertaining  to  weak  convergence  of  stochastic  processes.  These 
are  more  fully  discussed  by  Billingsley  (1968). 

bet  (1),H)  be  the  metric  space  of  all  functions  right -continuous 
on  the  unit  interval  [0,1]  and  having  left-hand  limits,  with  the  a- 
field  V generated  by  the  Skorohod  .Ij -topology . If  , n ■ 1,  and 
P are  probability  measures  on  0,  then  P^^  converges  weakly  to  P, 
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denoted  by  P =>  P,  if 

h(x)dP  (x)  ->  [ h(x)dP(x)  as  n ->  «>, 

^xeD  •’xeD 

for  every  bounded  Jj-continuous  real-valued  function  h on  D.  If 
X = {X(t) , 0<tsl}  is  a stochastic  process  such  that  each  X(t)  is 
finite-valued,  and  having  sample  paths  belonging  to  D,  the  distribu- 
tion of  X is  the  probability  measure  P^  on  V given  by 

Pj^(A)  = PX'^(A),  A e V. 

This  is  properly  defined,  since  the  mapping  X:  (D,P)  which 

takes  w into  the  function  X(t,Ci>),  0 s t s 1,  is  measurable  if  and 

only  if  each  X(t)  is  a r.v.  Correspondingly,  a sequence 

fXj^(t),  0<t<l},  n > 1,  of  stochastic  processes  is  said  to  converge 

weakly,  or  in  distribution,  to  the  process  (X(t) , 0<tsl},  denoted  by 

X„  X,  if  Py  ->  Py  . 
n XX 

n 

Now  let  be  an  i.i.d.  sequence  of  r.v.'s  with  marginal  d.f.  F 
and  such  that  0 s ^^(a))  < 1,  and  let  F^(*,(j)  be  the  empirical  d.f. 
of  . The  empirical  process  = {Y^(t) , 0<t5l}  is  defined 

by 

Y^(t,u)J  = n^(F^(t,ai)  - F(t))  . 

If  Y = (Y(t),  0<t^l}  is  the  normal  process,  which  may  be  assuiied  to 
l\ave  sample  paths  belonging  to  D,  defined  by 


CY(t)  = 0 


;ind 


l^(s)Y(t)  = F(s)(l  - F(t)), 


0 < s i t s 1 , 
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then  Y.  (Billingsley,  p.  141.)  In  particular,  if  the  are 

distributed  imifomly  on  [0,1],  so  that  F(t)  = t,  then  Y is  the 
Bro\vnian  Bridge  process,  which  we  may  assume  to  have  continuous  s:imple 
paths. 

Nhicli  of  the  interest  in  tlie  empirical  process  is  due  to  its  use- 
fulness, when  appropriate  hounded  continuous  functions  h on  1)  arc 
considereii,  in  deriving  the  asymiptotic  distributions  of  tlie  Kolmogorov - 
Smirnov  statistics,  unportant  in  the  tlieory  of  nonparametric  inference, 
for  arbitrary  continuous  marginal  d.f.'s  T (see,  for  examj^le,  Breiman 
(1068,  p.  284)  and  Billingsley  (1968,  p.  104)  ).  Also  of  interest  is 
tlie  fiuniliar  Glivenko-Cantelli  theorem,  a strong  laiv  of  large  nunbers 
analogue  for  empirical  processes,  according  to  which  the  sample  d.f.'s 
almost  surely  converge  uniformly  to  the  population  (marginal)  d.f. 
(Billingsley  (1968,  p.  105)  ).  Other  results  include  the  law  of  the 
iterated  logaritlim  for  empirical  processes  (sec,  for  example,  Csdrgo- 
Rdvdsy  (1974)  I as  well  as  extensions  of  these  results  to  situations 
involving  dependent  sequences  (Billingsley  (1968,  p.  197),  Deo 

(1975b)  1. 

Having  provided  a few  basic  facts  about  the  empirical  process,  we 
now  proceet.1  to  define  an  analagous  stochastic  process  and  develop  its 
weak  convergence  properties.  Again  let  be  an  i.i.d.  sequence  with 

marginal  d.f.  f.  Suppose  that  F satisfies  one  of  the  following 
conditions : 

a)  F has  left  endpoint  x^  = and  is  continuous  in  an  intei*val 
(-»,d). 

b)  F has  a finite  left  endjinint  x^^  such  that  = 0 and  is 
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continuous  in  an  interval  (x^,  Xq+6) , 


Let  be  an  intermediate  rank  sequence.  Since  0 there  is 


an 


integer  N,,  > 1 such  that  for  n > , — < F(d  - 0)  if  F satis- 

u k u n 

fies  a),  :ind  < F(x^  -••6-0)  if  F satisfies  b) . In  either  case 

” ^ tV 

fl"  1 

there  are  ninnbers  x^  ^ such  that  F(x^  M = , for  each  t, 

n ^ n n ’ 


0 < t s 1 , ;md  for  n 5 Nq  . In  general,  we  may  define 


x^^^  = supjx:  F(x)  < 


tk 


n 


for  0 s t < 1 and  for  each  nil. 


F-or  each  nil  let  be  the  empirical  d.f.  of 


. We  define  stochastic  processes  = {X^(t) , Ostsl}  by 
(5.2.1)  Xj^(t,w)  = 


n 

1. 

k^ 

n 


F w) 2. 

n^  n ’ n 


Since  for  fixed  n,  x. 


(t)  .. 


as  a function  of  t is  right -continuous 


with  left-hand  limits  on  [0,1],  and  actually  is  continuou;^  if  n > N„  , 


and  since  is  in  fact  a d.f.,  it  is  clear  that  the  sample 


paths  of  .Xj^  are  elements  of  D.  Our  object  in  this  section  is  to 


show  that  Xj^  — >•  W,  where  W = {W(t) , 0^t<l)  is  the  standard  Weiner 


process,  which  is  characterized  as  the  normal  process  with 


FW(t)  = 0 


and 


liW(s)W(t)  = min(s,t),  0 < s,  t < 1. 


As  is  well-known,  W may  be  assumed  to  have  continuous  sample  paths, 
and  of  course  W(0)  = 0 w.p.l. 
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I .eiimi;!  5.2.  I . i"hc  f inite  dimensional  distributions  of  converge  to 
those  of  W.  Hiat  is,  for  given  0 < t^  < ...  < t^  < 1,  the  random 
vector  ...  converges  weakly  to  the  random  vector 

(iVtt^).  ...  ,U(tj]. 


Proof:  Since  = 0 for  all  n,  we  may  as  well  suppose  that 

6 < tj  < ...  < 1 ^ - 1-  Let  Cp  ...  ,c^  be  real  numbers,  llien  for 
each  n we  liave 


1 f ” 

c.X  (t.)  + ...  + c X (t  ) = I 

1 n 1 m n m ,bl  1 


say,  where 


n 


t.k 
1 n 


(tJ  n 


j n 


+ . . . + Cp,  I 1 
m ^ 


j=i 


t k 
m n 


(t  ) n 


I K : ^ 

J = 1 


n,J 


t k 
VI  n 


(t  J n 
m U-<x  ^ ] 

X ■ = E c - .1.  ^ 
n.J  ti  b ^ 


k'^ 

n 


Consider  the  array  fX^^  j^n-N  l<j^n  ‘ '‘'^^ce  the  sequence 

independent,  so  arc  the  r.v. 's  X - , j = l,...,n,  f'^r  eacli  n,  and 

> J 

clearly  EX  = P-  Also  wc  have 


n Var  X . = c^t, 
n,j  1 1 


t,k  X 

1 - "1  + . 

^ 2„ 

t k x 
1 ni  n 

. + c t 

1 - 

n J 

m m 

n J 

+ f—  y c c t k 
•^n  l<u<v<m  b V M n 


t k 
V n 


so  that 


n Var  X ■ >•  cTt,  + ...  + eft  +2  T c c t 
"’J  ^ ^ lsu<vsm 


= o 
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say.  Since  k ->  «=  it  is  clear  that  X . satisfies  the  Lindeberg 
condition 


lim  1 E 
n i=l 
n 

;ind  hence  ^ X 


n,j  l|Xj^^j|>e]J 


= 0 for  every  c > 0, 


j=l 


n,J 


is  asymptotically  normal  with  mean  zero  and  vari- 


;xnce  a 


. That  is,  X^^j  =>  CjW(tp  + ...  + where  for 

M = 1,  ...  ,m,  W(t^)  is  normally  distributed  with  mean  zero  and 

variance  t^  , and  hW(t^)W(t^)  = t^  for  p < v.  Then  by  the  Cramdr- 
IVold  device  the  lemma  follows. 

Following  a procedure  similar  to  that  used  for  the  empirical 
process,  we  may  now  obtain  the  main  weak  convergence  result. 


Theorem  5.2.2.  Let  be  i.i.d.  with  marginal  d.f.  F satisfying 

either  condition  a)  or  b)  above,  and  let  k^  be  an  intermediate  rank 

sequence.  'Iben  for  the  sequence  of  stochastic  processes  X^  defined 

by  (5.2.1),  we  have  X W. 

n 


Proof:  According  to  ITieorem  15.6  of  Billingsley  (1968),  in  addition  to 

the  convergence  of  the  finite  dimensional  distributions,  in  order  that 
X^  IV  it  is  sufficient  that  there  he  a nondecreasing  continuous 
function  f on  [0,1]  such  that 


(5.2.2)  E|X^(t)  - X^(t^)|^|Xj^(t2)  - X^(t)|'  s (f(t2)  - f(tj))^ 

for  0stj<t<t2Sl  and  for  all  (large)  n. 

Let  0<t^st<t.,sl  ;md  n i be  given.  Define 


a. 

1 


*■  n 'in-* 


Pi 


and 


1S8 


= I 


n "in  -' 


^^1^  ftll  (ri 

where  p^  = I’  x^  ^ 'l  ' '^n  " ’’  ^ ^"1  "''n  “ 


■’S.*''  - -’‘..(‘l'  ■ V jj  0., 


\,'*2>  ■ •'n'*>  ° -T  ^ ®i  • 

”2  n 1 

n 

Since  the  arc  independent,  and  since  1;  = h 3^  = 0,  i = 1,  ..., 

n,  we  have  hy  stra ightfonvai'd  calculations  tliat 

( 'v  1-f  ? 1“  ^2  ^ " 

1.  ) a.  Id-  = n li  a,  B,  + n(n  - 1)  ha"  I;  B, 

li=l  U lj=i  ij  J 1 i I 


+ 2n(n  - l)(h  a-^Bp^  . 


iluis  since 


i;  a^Bj  = Pj(l  - P))“P2  + P2(.l  ■ ■ P]  ■ P2^PlPz 


2 2 

hajhB^  = Pj(l  - P|)P2(1  - P2)  •-  PjP- 


i:  a^Bj  = -PiU  - Pi)P2  - P2^  ■ P2^Pl  ‘ Pi  ‘ P2^P]P2 


= -PiP 


1'2  ’ 


f n i2pi  ->2  , 

F,  I a.  I B-  s h n-  p p,  . 
ii=l  lp=i  'I  ' ^ 

k k 

Bvit  pj  = (t  - tj)^  ;ind  p^  = (t2  - t)j^  , so  hat 
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n 

> 

2 

r 

E 

1 

“i. 

I Bi 

4=1 

4=1 

1 lenee 


U|x„(t)  - X„(tj)l^|X^(t2)  - < 6(t  - tjHtj  - t) 

s 6(t^  - t,)2  . 


Therefore  (5.2.2)  holds  with  f(t)  = t,  completing  the  proof. 


I 


1 
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